-- Logs begin at Thu 2022-08-04 21:12:26 UTC, end at Thu 2022-08-04 22:47:18 UTC. -- Aug 04 22:11:59.841113 dv-cinder-852211-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 22:11:59.852678 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 22:11:59 2022] *** Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: nodename: dv-cinder-852211-1-iscsi Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: machine: x86_64 Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: clock source: unix Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: pcre jit disabled Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: detected number of CPU cores: 4 Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: current working directory: / Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: detected binary path: /usr/bin/uwsgi-core Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: your processes number limit is 47680 Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: your memory page size is 4096 bytes Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: detected max file descriptor number: 2048 Aug 04 22:11:59.854518 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: lock engine: pthread robust mutexes Aug 04 22:11:59.855511 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: thunder lock: enabled Aug 04 22:11:59.855511 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 22:11:59.855511 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 22:11:59.894599 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: Python main interpreter initialized at 0x55cfef8d39c0 Aug 04 22:11:59.894599 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: python threads support enabled Aug 04 22:11:59.894599 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: your server socket listen backlog is limited to 100 connections Aug 04 22:11:59.894599 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: your mercy for graceful operations on workers is 90 seconds Aug 04 22:11:59.895026 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 22:11:59.895026 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: *** Operational MODE: preforking *** Aug 04 22:11:59.895295 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: *** uWSGI is running in multiple interpreter mode *** Aug 04 22:11:59.895295 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: spawned uWSGI master process (pid: 114713) Aug 04 22:11:59.900591 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: spawned uWSGI worker 1 (pid: 114714, cores: 1) Aug 04 22:11:59.900591 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: spawned uWSGI worker 2 (pid: 114715, cores: 1) Aug 04 22:11:59.900591 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 22:11:59.895504 dv-cinder-852211-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 22:12:00.568266 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 22:12:00.576211 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 22:12:01.659842 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 22:12:01.659842 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: from cryptography.utils import int_from_bytes Aug 04 22:12:01.660575 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 22:12:01.660575 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: from cryptography.utils import int_from_bytes Aug 04 22:12:01.663229 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 22:12:01.663229 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: from cryptography.utils import int_from_bytes Aug 04 22:12:01.663663 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 22:12:01.663663 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: from cryptography.utils import int_from_bytes Aug 04 22:12:04.165120 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 22:12:04.165692 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 22:12:04.165901 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 22:12:04.166259 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 22:12:04.166516 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 22:12:04.166903 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.167226 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.167546 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.167863 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.168192 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.168499 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.168816 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.169132 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.169494 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.169755 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.170069 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.170390 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-1-iscsi {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.170707 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.170974 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 22:12:04.171329 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.171418 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 22:12:04.171499 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.171593 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.171745 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 22:12:04.171892 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.172106 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 22:12:04.172206 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.172364 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 22:12:04.172496 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.172752 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.172987 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.173091 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.174160 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.174317 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.174429 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.174518 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.174518 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.174673 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.174673 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.174974 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.175066 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.175156 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.175244 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.175324 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.175427 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.175518 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.175608 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.175689 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.175811 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.175900 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.176134 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-1-iscsi {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.176233 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.176454 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.176551 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-1-iscsi {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.176761 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.176858 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.177071 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.177164 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.177392 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.177526 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.177718 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.177846 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.178042 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.178172 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.178347 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.178444 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.178756 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.178894 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.179088 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.179183 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.179397 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.179492 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.179721 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.179809 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.180622 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.180726 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.181069 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.181168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.181528 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.181639 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.181854 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.181948 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.182164 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.182258 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.182474 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.182567 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.182791 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.182930 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.183095 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.183190 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-1-iscsi {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.183403 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.183493 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.183656 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.183785 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.183964 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.184113 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.184286 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.184494 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.184610 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.184807 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.184932 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.185118 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.185214 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.185426 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.185529 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.185753 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.185856 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.186071 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.186157 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.186376 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.186463 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.186684 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.186784 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.186990 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.187086 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.187295 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.187393 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.187601 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.187699 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.187907 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.188039 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.188212 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.188307 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.188518 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.188614 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.188823 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.188909 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.189129 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.189216 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.189382 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.189503 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.189717 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.189812 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.190039 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.190127 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.190361 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.190449 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.109 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.190680 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.109 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.190766 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.190930 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.191025 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.191180 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.191312 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.191499 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.191628 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.191819 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.191919 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.192129 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.192223 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.192437 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.192531 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.192745 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.192845 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.193054 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.193142 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.193362 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.193469 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.193697 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.193808 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.194007 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.194105 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.194313 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.194400 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.194583 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.194677 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.194884 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.194972 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.195188 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.195282 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.195504 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.196205 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.196512 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.196832 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.196941 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.197139 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.197281 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.109 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.197459 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.197566 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.109 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.197771 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.197860 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.198081 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.198178 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.198388 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.198484 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.198694 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.198783 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.199004 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.199093 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.199308 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.199399 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.199614 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.199715 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.199917 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.200011 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.200220 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.200308 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.200535 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.200623 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.200852 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.200941 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.201159 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.201257 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.201477 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.201566 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.201783 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.201879 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.202087 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.202182 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.202402 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.202494 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.202705 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.202838 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.203010 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.203133 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.203317 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.203412 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.203621 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.203716 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.203923 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.204011 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.204230 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.204325 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.204537 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.204624 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.204842 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.204940 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.205180 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.205290 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.205465 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.205567 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.205773 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.205861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.206079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.206174 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.206386 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.206484 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.206685 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.206783 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.206987 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.207085 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.207289 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.207378 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.207591 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.207679 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.207892 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.207981 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.208192 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.208290 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.208492 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.208580 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.208789 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.208885 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.209093 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.209188 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.209422 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.209512 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.209736 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.209833 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.210041 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.210127 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.210343 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.210436 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.210659 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.210751 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.210965 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.211052 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.211367 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.211684 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.211788 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.211998 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.212093 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.212328 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.212416 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.212658 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.212755 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.212978 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.213077 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.213289 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.213377 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.213623 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.213714 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.213931 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.214017 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.214237 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.214325 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.214545 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.214635 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.214852 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.214940 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.215158 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.215290 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.215461 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.215559 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.215783 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.215878 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.216094 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.216188 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.216405 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.216533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.216716 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.216811 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.217021 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.217120 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.217337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:12:04.217483 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.217684 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.217772 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.218003 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.218105 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.218310 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.218399 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.218646 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.218733 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.218979 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.219082 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.219287 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.219374 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.219609 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.219697 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.219923 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.220020 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.220229 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.220323 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.220537 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.220673 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.220846 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.220944 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.221164 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.221304 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.221503 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.221595 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.221814 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.221917 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.222220 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.222441 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.222528 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.222751 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.222841 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.223059 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.223154 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.223367 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.223463 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.223674 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.223770 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.223990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.224078 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.224307 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.224394 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.224627 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.224723 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.224937 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.225035 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.225250 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.225353 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.225588 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.225680 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.225899 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.225994 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.226209 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.226311 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.226512 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.226639 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.226961 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.227068 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.227145 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.227444 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.227621 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.227747 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.227943 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.228062 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.228273 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.228376 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.228613 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.228702 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.228930 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.229019 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.229252 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.229351 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.229595 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.229694 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.229902 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.229993 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.230211 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.230300 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.230515 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.230612 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.230823 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.230955 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.231131 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.231221 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.231434 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.231544 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.231753 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.231851 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.232065 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.232162 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.232365 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.232456 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.232677 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.232765 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.232976 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.233064 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.233276 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.233366 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.233611 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.233702 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.233919 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.234007 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.234221 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.234309 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.234533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.234635 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.234835 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.234923 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.235180 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.235277 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.235464 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.235571 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.235772 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.235867 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.236101 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.236189 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.236408 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.236506 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.236714 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.236802 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.237023 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.237110 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.237335 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.238504 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.238596 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.238678 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.238678 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.238807 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.238884 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.238952 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.239025 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.239092 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.239165 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.239165 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.239299 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.239417 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.239606 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.239833 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.239922 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.240017 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.240237 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.240335 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.240545 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.240676 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.240857 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.240949 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.241177 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.241267 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.241508 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.241601 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.241812 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.241911 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.242113 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.242202 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.243085 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.243192 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.243263 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.243749 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.243839 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.244087 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.244178 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.244405 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.244493 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.244730 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.244817 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.245050 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.245138 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.245361 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.245494 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.245707 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.245805 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.246018 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.246106 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.246326 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.246424 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.246631 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.246718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.246938 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.247027 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.247244 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.247346 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.247551 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.247638 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.247855 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.247941 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.248163 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.248259 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.248467 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.248554 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.248774 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.248869 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.249081 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.249178 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.249380 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.249565 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.249712 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.249800 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.250038 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.250127 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.250350 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.250440 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.250656 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.250743 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.250967 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.251057 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.251273 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.251368 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.251583 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.251669 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.251892 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.251991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.252200 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.252290 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.252508 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.252595 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.252817 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.252905 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.253131 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.253218 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.253461 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.253575 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.253780 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.253877 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.254086 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.254174 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.254409 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.254506 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.254711 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.254798 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.255024 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.255119 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.255320 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.255487 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.255631 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.255720 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.255953 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.256041 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.256262 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.256358 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.256572 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.256659 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.256879 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.256968 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.257194 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.257292 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.257520 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.257608 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.257825 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.257913 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.258751 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.258945 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.259057 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.259358 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.259601 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.259690 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.259931 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.260028 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.260256 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.260343 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.260563 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.260652 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.260863 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.260953 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.261173 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.261261 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.261504 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.261608 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.261806 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.261905 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.262375 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.262469 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.262686 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.262786 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.263003 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.263091 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.263309 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.263396 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.263623 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.263729 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.263935 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.264024 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.264234 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.264331 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.264541 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.264643 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.264843 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.264931 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.265152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.265239 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.265475 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.265578 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.265778 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.265868 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.266078 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.266167 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.266416 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.266506 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.266723 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.266818 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.267023 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.267111 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.267332 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.267419 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.267645 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.267739 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.267947 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.268035 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.268251 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.268347 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.268552 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.268646 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.268858 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.268946 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.269166 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.269254 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.269498 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.269590 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.269805 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.269905 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.270110 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.270199 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.270417 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.270503 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.270722 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.270818 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.271028 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.271115 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.271341 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.271430 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.271644 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.271739 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.271954 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.272059 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.272261 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.272360 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.272560 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.272658 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.272866 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.272955 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.273167 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.273254 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.273513 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.273789 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.274123 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.274441 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.274754 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.274874 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.275072 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.275198 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.275389 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.275514 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.275717 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.275845 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.276040 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.276160 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.276375 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.276472 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.276679 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.276781 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.276982 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.277080 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.277286 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.277385 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.277614 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.277705 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.277924 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.278026 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.278225 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.278314 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.278526 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.278624 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.278829 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.278931 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.279134 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.279222 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.279433 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.279521 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.279736 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.279833 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.280036 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.280131 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.280335 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.280424 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.280646 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.280735 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.280946 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.281041 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.281255 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.281356 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.281578 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.281669 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.281897 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.281993 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.282204 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.282292 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.282505 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.282595 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.282804 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.282891 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.283103 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.283389 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.283481 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.283725 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.283814 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.284047 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.284136 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.284370 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.284460 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.284693 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.284781 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.284994 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.285081 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.285296 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.285386 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.285652 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.285745 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.285954 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.286043 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.286255 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.286367 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.286554 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.286644 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.286858 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.286947 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.287165 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.287313 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.287463 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.287553 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.287771 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.287859 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.288075 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.288164 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.288380 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.288469 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.288687 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.288775 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.288987 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.289076 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.289312 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.289453 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.289654 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.289964 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.290351 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.290470 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.290660 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.290794 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.290962 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.291122 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.291272 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.291436 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.291577 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.291756 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.291877 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.292075 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.292247 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.292411 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.292509 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.292728 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.292828 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.293038 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.293136 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.293339 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.293461 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.293665 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.293767 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.293977 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.294090 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.294282 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.294389 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.294584 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.294672 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.294905 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.295001 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.295213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.295300 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.295513 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.295609 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.295813 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.295902 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.296119 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.296205 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.296418 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.296515 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.296716 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.296814 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.297023 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.297110 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.297338 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.297474 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.297673 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.297762 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.297972 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.298061 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.298278 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.298380 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.298578 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.298668 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.298878 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.298968 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.299179 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.299268 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.299481 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.299568 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.299777 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.299865 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.300076 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.300166 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.300374 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.300462 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.300674 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.300770 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.300971 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.301061 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.301268 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.301363 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.301606 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.301708 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.301906 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.301995 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.302208 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.302348 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.302493 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.302639 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.302802 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.302940 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.303117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.303255 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.303420 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.303565 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.303708 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.303861 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.303998 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.304132 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.304312 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.304410 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.304619 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.304707 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.305483 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.305584 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.305923 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.306236 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.306325 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.306554 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.306642 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.306865 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.306961 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.307180 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.307270 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.307484 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.307573 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.307786 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.307883 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.308102 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.308197 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.308410 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.308497 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.308722 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.308819 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.309039 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.309136 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.309345 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.309464 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.309686 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.309784 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.309984 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.310071 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.310287 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.310375 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.310593 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.310759 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.310898 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.310985 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.311199 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.311293 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.311503 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.311592 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.311804 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.311893 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.312110 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.312252 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.312415 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.312512 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.312724 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.312811 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.313033 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.313129 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.313335 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.313511 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.313668 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.313757 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.313971 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.314060 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.314271 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.314362 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.314596 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.314686 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.314913 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.315010 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.315217 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.315313 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.315524 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.315613 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.315828 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.315926 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.316140 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.316228 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.316441 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.316538 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.316755 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.316852 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.317064 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.317151 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.317383 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.317499 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.317722 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.317872 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.318038 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.318177 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.318345 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.318501 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.318648 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.318785 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.318959 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.319098 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.319259 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.319396 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.319572 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.319712 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.319897 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.320042 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.320220 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.320359 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.321212 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.321491 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.321491 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.321823 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.321971 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.322110 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.322255 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.322392 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.322516 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.322667 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.322833 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.322971 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.323153 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.323273 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.323469 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.323595 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.323787 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.323895 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.324106 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.324195 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.324423 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.324603 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.324745 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.324919 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.325054 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.325211 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.325351 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.325644 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.325791 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.325958 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.326101 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.326244 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.326380 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.326560 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.326706 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.326872 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.327016 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.327164 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.327316 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.327476 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.327622 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.327785 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.327918 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.328093 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.328231 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.328395 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.328548 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.328730 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.328866 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.329044 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.329182 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.329358 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.329530 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.329687 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.329825 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.330011 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.330150 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.330334 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.330471 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.330645 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.330780 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.330956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.331092 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.331246 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.331382 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.331666 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.331804 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.331972 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.332115 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.332283 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.332381 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.332597 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.332732 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.332899 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.333036 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.333202 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.333463 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.333612 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.333757 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.333894 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.334038 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.334173 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.334311 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.334456 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.334542 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.334730 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.334880 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.335018 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.335164 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.335314 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.335459 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.335603 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.335735 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.335877 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.336023 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.336214 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.336468 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.336674 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.337073 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.337244 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.337388 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.337702 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.337842 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.338027 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.338117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.338345 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.338443 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.338648 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.338736 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.338969 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.339065 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.339278 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.339368 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.339580 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.339670 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.339883 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.339971 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.340186 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.340291 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.340513 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.340601 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.340815 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.340956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.341132 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.341272 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.341471 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.341618 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.341775 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.341912 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.342093 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.342232 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.342416 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.342582 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.342718 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.342865 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.343036 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.343180 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.343352 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.343493 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.343674 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.343837 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.343973 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.344111 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.344247 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.344381 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.344632 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.344779 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.344940 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.345082 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.345248 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.345390 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.345581 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.345741 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.345878 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.346021 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.346158 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.346294 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.346439 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.346580 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.346716 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.346854 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.347026 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.347173 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.347317 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.347455 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.347629 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.347775 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.347928 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.348064 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.348209 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.348353 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.348499 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.348636 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.348792 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.348930 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.349129 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.349268 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.349443 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.349592 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.349772 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.349917 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.350080 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.350214 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.350396 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.350533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.350708 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.350931 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.351072 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.351208 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.351352 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.351488 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.351636 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.351859 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.352015 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.352148 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.352354 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.352669 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.352814 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.352959 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.353112 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.353276 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.353470 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.353606 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.353753 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.353901 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.354044 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.354277 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.354415 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.354618 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.354764 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.354950 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.355086 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.355272 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.355415 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.355597 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.355745 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.355924 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.356058 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.356229 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.356367 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.356535 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.356686 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.356843 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.356981 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.357148 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.357285 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.357476 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.357614 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.357782 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.357928 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.358093 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.358233 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.358387 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.358523 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.358686 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.358821 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.358990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.359125 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.359316 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.359452 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.359622 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.359811 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.359960 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.360102 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.360243 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.360375 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.360519 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.360658 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.360826 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.360969 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.361133 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.361269 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.361444 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.361598 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.361744 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.361882 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.362053 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.362192 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.362405 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.362543 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.362729 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.362865 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.363041 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.363180 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.363351 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.363490 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.363644 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.363782 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.363955 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.364092 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.364265 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.364405 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.364581 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.364735 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.364900 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.364993 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.365211 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.365356 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.365544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.365679 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.365858 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.365994 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.366174 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.366282 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.366688 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.366775 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.367005 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.367093 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.367316 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.368102 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.368200 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.368500 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.368653 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.368816 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.368978 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.369133 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.369297 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.369485 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.369640 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.369792 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.369955 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.370096 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.370268 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.370405 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.370580 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.370714 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.370894 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.371016 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.371224 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.371337 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.371545 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.371634 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.371871 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.371962 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.372207 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.372296 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.372525 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.372623 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.372840 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.373052 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.373141 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.373393 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.373509 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.373734 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.373824 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.374058 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.374149 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.374381 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.374526 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.374695 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.374820 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.374999 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.375088 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.375322 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.375423 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.375630 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.375717 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.375932 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.376073 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.376244 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.376341 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.376550 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.376638 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.376853 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.376941 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.377155 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.377253 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.377490 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.377584 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.377800 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.377887 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.378103 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.378237 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.378413 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.378516 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.378716 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.378805 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.379042 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.379139 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.379346 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.379435 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.379648 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.379737 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.379951 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.380165 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.380318 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.380484 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.380625 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.380818 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.381040 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.381179 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.381314 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.381467 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.381614 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.381765 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.381904 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.382048 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.382193 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.382342 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.382476 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.382621 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.382761 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.382899 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.383110 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.383861 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.384182 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.384390 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.384535 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.384717 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.384851 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.385031 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.385176 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.385361 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.385529 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.385703 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.385843 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.386013 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.386165 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.386339 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.386428 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.386653 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.386742 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.386963 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.387462 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.387567 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.387811 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.387901 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.388181 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.388398 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.388537 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.388731 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.388822 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.389053 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.389141 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.389379 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.389548 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.389731 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.389820 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.390039 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.390179 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.390324 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.390467 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.390631 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.390776 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.390947 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.391085 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.391237 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.391379 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.391548 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.391697 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.391855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.391993 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.392164 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.392300 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.392468 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.392601 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.392774 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.392921 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.393088 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.393221 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.393393 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.393500 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.393724 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.393827 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.394029 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.394118 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.394335 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.394421 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.394644 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.394745 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.394952 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.395097 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.395238 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.395381 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.395551 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.395698 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.395857 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.395996 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.396170 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.396306 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.396475 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.396615 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.396783 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.396922 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.397091 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.397230 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.397381 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.397541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.397718 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.397855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.398022 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.398159 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.398308 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.398442 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.398629 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.398811 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.398981 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.399439 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.399579 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.399758 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.399902 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.400121 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.400260 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.400443 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.400582 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.400775 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.400911 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.401093 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.401230 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.401442 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.401583 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.401743 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.401894 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.402065 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.402206 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.402377 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.402611 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.402751 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.402956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.403102 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.403283 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.403429 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.403617 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.403757 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.403944 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.404083 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.404252 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.404390 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.404556 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.404701 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.404859 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.405005 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.405162 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.405299 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.405477 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.405615 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.405799 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.405957 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.406095 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.406231 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.406392 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.406531 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.406695 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.406840 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.407001 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.407146 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.407283 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.407419 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.407586 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.407748 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.407892 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.408029 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.408176 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.408314 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.408450 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.408597 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.408769 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.408908 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.409046 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.409182 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.409327 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.409496 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.409639 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.409776 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.409914 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.410050 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.410208 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.410344 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.410482 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.410662 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.410801 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.410981 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.411200 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.411337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.411482 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.411628 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.411765 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.411909 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.412046 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.412182 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.412316 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.412488 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.412627 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.412813 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.412959 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.413136 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.413286 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.413451 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.413597 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.413749 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.413886 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.414062 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.414200 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.414412 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.414902 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.415067 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.415158 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.415298 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.415431 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.415610 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.415769 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.415932 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.416071 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.416264 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.416401 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.416592 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.416738 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.416912 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.417049 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.417228 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.417361 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.417702 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.417867 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.418006 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.418191 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.418331 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.418481 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.418618 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.418800 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.418972 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.419107 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.419242 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.419417 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.419571 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.419717 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.419859 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.420023 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.420164 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.420323 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.420467 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.420676 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.420820 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.421004 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.421151 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.421289 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.421447 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.421592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.421732 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.421868 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.422019 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.422155 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.422291 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.422436 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.422576 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.422713 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.422857 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.423017 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.423156 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.423318 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.423463 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.423625 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.423773 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.423916 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.424051 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.424217 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.424355 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.424524 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.424663 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.424828 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.424967 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.425138 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.425287 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.425448 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.425594 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.425760 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.425899 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.426065 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.426209 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.426359 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.426495 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.426660 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.426798 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.426992 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.427140 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.427287 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 22:12:04.427423 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.427627 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.427951 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.428265 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.428587 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.428900 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.429223 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.429571 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.430458 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.431181 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.431531 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.431854 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.432180 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.432500 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.432817 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.433139 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.433480 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.433817 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.434151 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.434467 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.434794 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.435116 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.435442 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.435757 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.436074 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.436406 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.436722 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.437037 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.437350 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.437692 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.438006 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.438324 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.438638 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.438952 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.439270 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.439589 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.439919 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.440248 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.440585 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.440889 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.441217 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.441589 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.441908 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.442253 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.442583 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.442905 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.443220 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.443526 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:12:04.443773 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 22:12:04.582512 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO dbcounter [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] Registered counter for database nova_api Aug 04 22:12:04.603176 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG oslo_db.sqlalchemy.engines [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:12:04.603773 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO dbcounter [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Registered counter for database nova_api Aug 04 22:12:04.609895 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG dbcounter [-] [114715] Writer thread running {{(pid=114715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:12:04.624732 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_db.sqlalchemy.engines [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:12:04.631192 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writer thread running {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:12:04.667358 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.context [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cabbb7be-13c8-431a-acef-35fafb43c245(cell1) {{(pid=114715) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 22:12:04.671233 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG oslo_concurrency.lockutils [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:12:04.671702 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG oslo_concurrency.lockutils [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:12:04.673262 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG oslo_concurrency.lockutils [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:12:04.674012 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG oslo_concurrency.lockutils [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:12:04.674458 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG oslo_concurrency.lockutils [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:12:04.676416 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG oslo_concurrency.lockutils [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:12:04.678401 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO dbcounter [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] Registered counter for database nova_cell0 Aug 04 22:12:04.684408 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO dbcounter [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] Registered counter for database nova_cell1 Aug 04 22:12:04.690679 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.context [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cabbb7be-13c8-431a-acef-35fafb43c245(cell1) {{(pid=114714) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 22:12:04.691890 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG oslo_db.sqlalchemy.engines [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:12:04.694091 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG oslo_db.sqlalchemy.engines [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:12:04.694964 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:12:04.695542 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:12:04.697294 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:12:04.698134 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:12:04.698658 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:12:04.698899 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG dbcounter [-] [114715] Writer thread running {{(pid=114715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:12:04.700794 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:12:04.702961 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO dbcounter [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Registered counter for database nova_cell0 Aug 04 22:12:04.708588 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO dbcounter [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Registered counter for database nova_cell1 Aug 04 22:12:04.715875 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_db.sqlalchemy.engines [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:12:04.719407 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_db.sqlalchemy.engines [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:12:04.721888 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writer thread running {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:12:04.837857 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG dbcounter [-] [114715] Writer thread running {{(pid=114715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:12:04.847541 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO dbcounter [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] Registered counter for database nova_cell0 Aug 04 22:12:04.856853 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG oslo_db.sqlalchemy.engines [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:12:04.861681 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG dbcounter [-] [114715] Writer thread running {{(pid=114715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:12:04.866571 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writer thread running {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:12:04.876684 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO dbcounter [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Registered counter for database nova_cell0 Aug 04 22:12:04.884180 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_db.sqlalchemy.engines [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:12:04.890113 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writer thread running {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:12:05.221349 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: WARNING keystonemiddleware.auth_token [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 22:12:05.229209 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: WARNING keystonemiddleware.auth_token [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 22:12:05.250633 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: WARNING keystonemiddleware.auth_token [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 22:12:05.258866 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: WARNING keystonemiddleware.auth_token [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 22:12:05.578514 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: WARNING keystonemiddleware.auth_token [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 22:12:05.584661 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: WARNING keystonemiddleware.auth_token [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 22:12:05.590461 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfef8d39c0 pid: 114714 (default app) Aug 04 22:12:05.592722 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:12:05.593991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] 10.222.0.109 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001946 Aug 04 22:12:05.594418 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 1/1] 10.222.0.109 () {50 vars in 793 bytes} [Thu Aug 4 22:12:05 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:12:05.648532 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: WARNING keystonemiddleware.auth_token [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 22:12:05.655154 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: WARNING keystonemiddleware.auth_token [None req-29ae6634-ab23-4540-95bd-a0d2ff16c87d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 22:12:05.660507 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfef8d39c0 pid: 114715 (default app) Aug 04 22:13:21.595303 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:21.596327 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001497 Aug 04 22:13:21.596877 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 2/2] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:13:21 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:13:21.609334 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG dbcounter [-] [114715] Writing DB stats nova_api:SELECT=3 {{(pid=114715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:21.618801 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG dbcounter [-] [114715] Writing DB stats nova_cell0:SELECT=3 {{(pid=114715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:21.618801 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG dbcounter [-] [114715] Writing DB stats nova_cell1:SELECT=3 {{(pid=114715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:21.618801 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG dbcounter [-] [114715] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:22.509151 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-9f808a1c-48d9-45cc-ac7d-0829577f188b admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:22.544447 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-9f808a1c-48d9-45cc-ac7d-0829577f188b admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.940306 Aug 04 22:13:22.545468 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 1/3] 10.222.0.109 () {60 vars in 1297 bytes} [Thu Aug 4 22:13:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:13:24.776731 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:24.778380 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-0f0fd82c-ecbf-43aa-8528-ad08cc33656e None None] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002061 Aug 04 22:13:24.778956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 3/4] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:13:24 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:13:25.225900 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-5b28039c-abbf-4829-87e1-64c1119ad0f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "swap": 0, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:25.247321 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:13:25.247321 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: warnings.warn(msg) Aug 04 22:13:25.276880 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-5b28039c-abbf-4829-87e1-64c1119ad0f2 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.491668 Aug 04 22:13:25.277582 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 2/5] 10.222.0.109 () {64 vars in 1288 bytes} [Thu Aug 4 22:13:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:25.495967 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-72d674fb-944f-43ea-b1f2-68b2d54b7e8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:25.500295 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:13:25.500295 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: warnings.warn(msg) Aug 04 22:13:25.519661 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writing DB stats nova_api:SELECT=3 {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:25.520564 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writing DB stats nova_cell0:SELECT=3 {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:25.521278 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writing DB stats nova_cell1:SELECT=3 {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:25.522120 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writing DB stats nova_cell0:SELECT=3 {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:25.565568 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-72d674fb-944f-43ea-b1f2-68b2d54b7e8b admin admin] 10.222.0.109 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279365 Aug 04 22:13:25.569439 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 4/6] 10.222.0.109 () {64 vars in 1341 bytes} [Thu Aug 4 22:13:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:13:27.844992 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-5b28039c-abbf-4829-87e1-64c1119ad0f2 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:27.846934 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-5b28039c-abbf-4829-87e1-64c1119ad0f2 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002399 Aug 04 22:13:27.847904 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 3/7] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:13:27 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:13:28.541094 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-a95d4119-17b6-44da-b5d4-2905b1661431 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "swap": 0, "id": "d1"}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:28.562496 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:13:28.562496 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: warnings.warn(msg) Aug 04 22:13:28.584286 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-a95d4119-17b6-44da-b5d4-2905b1661431 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.730685 Aug 04 22:13:28.585101 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 5/8] 10.222.0.109 () {64 vars in 1288 bytes} [Thu Aug 4 22:13:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:28.597823 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-bf94f82a-4bf0-4fe6-a497-9fcc2799fcc3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:28.600604 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:13:28.600604 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: warnings.warn(msg) Aug 04 22:13:28.637175 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-bf94f82a-4bf0-4fe6-a497-9fcc2799fcc3 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042830 Aug 04 22:13:28.645512 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 4/9] 10.222.0.109 () {64 vars in 1341 bytes} [Thu Aug 4 22:13:28 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:13:30.916815 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-a95d4119-17b6-44da-b5d4-2905b1661431 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:30.917853 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-a95d4119-17b6-44da-b5d4-2905b1661431 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001472 Aug 04 22:13:30.918404 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 6/10] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:13:30 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:13:31.446091 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-e8cc7e31-c56e-4164-aba1-df803433b5db admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:31.472801 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-e8cc7e31-c56e-4164-aba1-df803433b5db admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.546587 Aug 04 22:13:31.473380 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 5/11] 10.222.0.109 () {64 vars in 1288 bytes} [Thu Aug 4 22:13:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:31.486528 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-bce2cd11-0acf-4f10-9f3f-f7564ccee990 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:31.519337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-bce2cd11-0acf-4f10-9f3f-f7564ccee990 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036533 Aug 04 22:13:31.520244 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 7/12] 10.222.0.109 () {64 vars in 1341 bytes} [Thu Aug 4 22:13:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:13:33.742786 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-e8cc7e31-c56e-4164-aba1-df803433b5db admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:33.743803 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-e8cc7e31-c56e-4164-aba1-df803433b5db admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001449 Aug 04 22:13:33.744222 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 6/13] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:13:33 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:13:34.212479 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-08a8d09f-8b90-46ce-86ab-237d7b3107df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "id": "d3"}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:34.233074 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-08a8d09f-8b90-46ce-86ab-237d7b3107df admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.482920 Aug 04 22:13:34.233965 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 8/14] 10.222.0.109 () {64 vars in 1288 bytes} [Thu Aug 4 22:13:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:34.246903 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-f2334525-9638-432c-8be6-4b114b462b50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:34.272437 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-f2334525-9638-432c-8be6-4b114b462b50 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029769 Aug 04 22:13:34.281498 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 7/15] 10.222.0.109 () {64 vars in 1341 bytes} [Thu Aug 4 22:13:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:13:36.511640 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-08a8d09f-8b90-46ce-86ab-237d7b3107df admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:36.512901 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-08a8d09f-8b90-46ce-86ab-237d7b3107df admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001443 Aug 04 22:13:36.513299 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 9/16] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:13:36 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:13:36.944401 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-d35304dd-a30e-4ea9-8e0f-4bf9f92ea201 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:36.967269 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-d35304dd-a30e-4ea9-8e0f-4bf9f92ea201 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.447982 Aug 04 22:13:36.968008 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 8/17] 10.222.0.109 () {64 vars in 1288 bytes} [Thu Aug 4 22:13:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:36.980241 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-daea46cd-e040-4210-b4e9-cde9484a7c9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:37.005183 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-daea46cd-e040-4210-b4e9-cde9484a7c9c admin admin] 10.222.0.109 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028650 Aug 04 22:13:37.005774 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 10/18] 10.222.0.109 () {64 vars in 1341 bytes} [Thu Aug 4 22:13:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:13:39.254352 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-d35304dd-a30e-4ea9-8e0f-4bf9f92ea201 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:39.255924 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-d35304dd-a30e-4ea9-8e0f-4bf9f92ea201 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002563 Aug 04 22:13:39.256710 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 9/19] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:13:39 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:13:39.730162 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-3e644727-fd04-440b-8069-1139e7babbdf admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:39.754562 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-3e644727-fd04-440b-8069-1139e7babbdf admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.490694 Aug 04 22:13:39.755143 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 11/20] 10.222.0.109 () {60 vars in 1297 bytes} [Thu Aug 4 22:13:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:13:42.505643 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-d35304dd-a30e-4ea9-8e0f-4bf9f92ea201 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:42.506649 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-d35304dd-a30e-4ea9-8e0f-4bf9f92ea201 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001528 Aug 04 22:13:42.507078 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 10/21] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:13:42 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:13:42.994892 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-30a3b454-b47f-4efd-adfe-1cf9842c3540 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "disk": 1, "ram": 512}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:43.014104 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-30a3b454-b47f-4efd-adfe-1cf9842c3540 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500914 Aug 04 22:13:43.014660 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 12/22] 10.222.0.109 () {64 vars in 1288 bytes} [Thu Aug 4 22:13:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:43.026664 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-79ec4522-0b13-4cd1-914d-fdbe96a93131 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:43.051940 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-79ec4522-0b13-4cd1-914d-fdbe96a93131 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028830 Aug 04 22:13:43.052529 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 11/23] 10.222.0.109 () {64 vars in 1338 bytes} [Thu Aug 4 22:13:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:13:45.226961 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-30a3b454-b47f-4efd-adfe-1cf9842c3540 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:45.228149 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-30a3b454-b47f-4efd-adfe-1cf9842c3540 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001655 Aug 04 22:13:45.228707 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 13/24] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:13:45 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:13:45.631428 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-6cb381f5-2e64-456c-b805-1e845c82939c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "swap": 0, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:45.649870 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-6cb381f5-2e64-456c-b805-1e845c82939c admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.414802 Aug 04 22:13:45.650414 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 12/25] 10.222.0.109 () {64 vars in 1288 bytes} [Thu Aug 4 22:13:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 22:13:45.664924 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-a14c6c8e-21d6-47b6-a9cc-6d5bf5857851 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:45.688266 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-a14c6c8e-21d6-47b6-a9cc-6d5bf5857851 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027889 Aug 04 22:13:45.688842 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 14/26] 10.222.0.109 () {64 vars in 1338 bytes} [Thu Aug 4 22:13:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:13:47.937380 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-6cb381f5-2e64-456c-b805-1e845c82939c admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:47.938419 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-6cb381f5-2e64-456c-b805-1e845c82939c admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001780 Aug 04 22:13:47.938821 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 13/27] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:13:47 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:13:48.362399 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-b8286d27-dd91-4b60-aa06-ef291929322e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3"}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:48.383970 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-b8286d27-dd91-4b60-aa06-ef291929322e admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.439130 Aug 04 22:13:48.384521 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 15/28] 10.222.0.109 () {64 vars in 1288 bytes} [Thu Aug 4 22:13:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:48.396537 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-34e90d1c-6582-4d4f-8343-c5a4c5e9e627 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:48.424867 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-34e90d1c-6582-4d4f-8343-c5a4c5e9e627 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031899 Aug 04 22:13:48.425511 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 14/29] 10.222.0.109 () {64 vars in 1338 bytes} [Thu Aug 4 22:13:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:13:50.660894 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-b8286d27-dd91-4b60-aa06-ef291929322e admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:50.661936 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-b8286d27-dd91-4b60-aa06-ef291929322e admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001486 Aug 04 22:13:50.662343 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 16/30] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:13:50 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:13:51.253314 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-b4b18108-2f1b-4536-9037-7a4ccb56ffc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:51.284165 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-b4b18108-2f1b-4536-9037-7a4ccb56ffc0 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.615464 Aug 04 22:13:51.293135 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 15/31] 10.222.0.109 () {64 vars in 1288 bytes} [Thu Aug 4 22:13:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 22:13:51.300120 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-d16e3e4a-0ec2-4c7a-8c87-9ba3eddd9b5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:51.328616 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-d16e3e4a-0ec2-4c7a-8c87-9ba3eddd9b5a admin admin] 10.222.0.109 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032004 Aug 04 22:13:51.329531 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 17/32] 10.222.0.109 () {64 vars in 1338 bytes} [Thu Aug 4 22:13:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:13:53.660481 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-b4b18108-2f1b-4536-9037-7a4ccb56ffc0 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:13:53.661548 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-b4b18108-2f1b-4536-9037-7a4ccb56ffc0 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001454 Aug 04 22:13:53.661948 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 16/33] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:13:53 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:13:54.108471 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-fb0a5b96-6e7e-4893-ad40-e36aaa3b4665 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "disk": 160, "ram": 16384}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:54.130980 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-fb0a5b96-6e7e-4893-ad40-e36aaa3b4665 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.462624 Aug 04 22:13:54.131530 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 18/34] 10.222.0.109 () {64 vars in 1288 bytes} [Thu Aug 4 22:13:53 2022] POST /compute/v2.1/flavors => generated 410 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:54.144712 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-83af2c4a-a1c5-45df-ac79-9617171d3634 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:13:54.151432 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG dbcounter [-] [114715] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=114715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:54.177443 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-83af2c4a-a1c5-45df-ac79-9617171d3634 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036224 Aug 04 22:13:54.178054 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 17/35] 10.222.0.109 () {64 vars in 1338 bytes} [Thu Aug 4 22:13:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:14:13.291086 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-fb0a5b96-6e7e-4893-ad40-e36aaa3b4665 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:13.292083 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-fb0a5b96-6e7e-4893-ad40-e36aaa3b4665 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001438 Aug 04 22:14:13.292503 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 19/36] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:14:13 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:14:13.682293 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-6745447b-40b7-40a7-ba69-1ba6e63fe7a8 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:13.700943 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-6745447b-40b7-40a7-ba69-1ba6e63fe7a8 admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.402323 Aug 04 22:14:13.701402 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 18/37] 10.222.0.109 () {60 vars in 1297 bytes} [Thu Aug 4 22:14:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:14:14.753324 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-fb0a5b96-6e7e-4893-ad40-e36aaa3b4665 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:14.754355 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-fb0a5b96-6e7e-4893-ad40-e36aaa3b4665 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001476 Aug 04 22:14:14.754754 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 20/38] 10.222.0.109 () {56 vars in 1079 bytes} [Thu Aug 4 22:14:14 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:14:15.294940 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-bf553874-209b-4f1b-856e-0b34ae00bef8 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:15.300655 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.wsgi [None req-bf553874-209b-4f1b-856e-0b34ae00bef8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-bf553874-209b-4f1b-856e-0b34ae00bef8 admin admin] Request method failure captured: Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Accept: application/json Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Accept-Encoding: gzip, deflate Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Connection: keep-alive Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Content-Length: 0 Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Host: 10.222.0.109 Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Openstack-Api-Version: compute 2.90 Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Openstack-System-Scope: None Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: User-Agent: python-novaclient Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Auth-Token: gAAAAABi7ES23xCfeC0DkK4SLUZMKr_04FQcE9uYT139-4MO9sUXCwPi7gsu8fsmtC5hgU1Y5BeohjobeLgP6U1l3XyEgFgqB3Pmt1yeCMXqE8Fj8m7gmviJSah0jPjJ8VlH4bUyACaeI_BVipnSLOVEutSvZ7Fz_STBVbYw48csYTe3kiqpgNY Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Domain-Id: None Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Domain-Name: None Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Identity-Status: Confirmed Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Is-Admin-Project: True Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Project-Domain-Id: default Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Project-Domain-Name: Default Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Project-Id: ee8a7cb4ed304a5598e10ca71a963013 Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Project-Name: admin Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Role: member,admin,reader Aug 04 22:14:15.304544 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Roles: member,admin,reader Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/ee8a7cb4ed304a5598e10ca71a963013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_ee8a7cb4ed304a5598e10ca71a963013", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ee8a7cb4ed304a5598e10ca71a963013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ee8a7cb4ed304a5598e10ca71a963013"}]}] Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Tenant: admin Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Tenant-Id: ee8a7cb4ed304a5598e10ca71a963013 Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Tenant-Name: admin Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User: admin Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User-Domain-Id: default Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User-Domain-Name: Default Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User-Id: f59916fe4d6d4a6aac1fc1ff790ac163 Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User-Name: admin Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: method: > Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: exception: Flavor 42 could not be found. Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: action_args: {'id': '42'} Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:14:15.306168 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:14:15.307152 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:15.309533 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-bf553874-209b-4f1b-856e-0b34ae00bef8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:14:15.311485 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-bf553874-209b-4f1b-856e-0b34ae00bef8 admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.410682 Aug 04 22:14:15.311485 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 19/39] 10.222.0.109 () {60 vars in 1195 bytes} [Thu Aug 4 22:14:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 22:14:15.315744 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-203add41-4e11-4dc8-9462-919444e22770 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:15.320495 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:15.341178 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-203add41-4e11-4dc8-9462-919444e22770 admin admin] 10.222.0.109 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.028934 Aug 04 22:14:15.341745 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 21/40] 10.222.0.109 () {60 vars in 1215 bytes} [Thu Aug 4 22:14:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:14:15.352095 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-ec3a044d-395a-4b9d-94e7-c2a531ae5328 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:15.376583 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-ec3a044d-395a-4b9d-94e7-c2a531ae5328 admin admin] 10.222.0.109 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.028467 Aug 04 22:14:15.377051 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 20/41] 10.222.0.109 () {60 vars in 1215 bytes} [Thu Aug 4 22:14:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:14:15.388458 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-83b809d2-a55a-4896-b614-3cf964e2139e admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:15.394572 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.wsgi [None req-83b809d2-a55a-4896-b614-3cf964e2139e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-83b809d2-a55a-4896-b614-3cf964e2139e admin admin] Request method failure captured: Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Accept: application/json Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Accept-Encoding: gzip, deflate Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Connection: keep-alive Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Content-Length: 0 Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Host: 10.222.0.109 Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Openstack-Api-Version: compute 2.90 Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Openstack-System-Scope: None Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: User-Agent: python-novaclient Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Auth-Token: gAAAAABi7ES23xCfeC0DkK4SLUZMKr_04FQcE9uYT139-4MO9sUXCwPi7gsu8fsmtC5hgU1Y5BeohjobeLgP6U1l3XyEgFgqB3Pmt1yeCMXqE8Fj8m7gmviJSah0jPjJ8VlH4bUyACaeI_BVipnSLOVEutSvZ7Fz_STBVbYw48csYTe3kiqpgNY Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Domain-Id: None Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Domain-Name: None Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Identity-Status: Confirmed Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Is-Admin-Project: True Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Project-Domain-Id: default Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Project-Domain-Name: Default Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Project-Id: ee8a7cb4ed304a5598e10ca71a963013 Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Project-Name: admin Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Role: member,admin,reader Aug 04 22:14:15.397991 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Roles: member,admin,reader Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/ee8a7cb4ed304a5598e10ca71a963013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_ee8a7cb4ed304a5598e10ca71a963013", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ee8a7cb4ed304a5598e10ca71a963013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ee8a7cb4ed304a5598e10ca71a963013"}]}] Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Tenant: admin Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Tenant-Id: ee8a7cb4ed304a5598e10ca71a963013 Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Tenant-Name: admin Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User: admin Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User-Domain-Id: default Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User-Domain-Name: Default Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User-Id: f59916fe4d6d4a6aac1fc1ff790ac163 Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User-Name: admin Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: method: > Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: exception: Flavor 42 could not be found. Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: action_args: {'id': '42'} Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:14:15.399474 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:14:15.400269 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:15.401337 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-83b809d2-a55a-4896-b614-3cf964e2139e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:14:15.402365 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-83b809d2-a55a-4896-b614-3cf964e2139e admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015580 Aug 04 22:14:15.402365 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 22/42] 10.222.0.109 () {60 vars in 1195 bytes} [Thu Aug 4 22:14:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 22:14:16.365024 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-ec3a044d-395a-4b9d-94e7-c2a531ae5328 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:16.366657 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-ec3a044d-395a-4b9d-94e7-c2a531ae5328 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002132 Aug 04 22:14:16.367042 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 21/43] 10.222.0.109 () {56 vars in 1079 bytes} [Thu Aug 4 22:14:16 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:14:16.890544 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-c0c8c7c3-758f-401a-a985-c1b1b528590e admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:16.896760 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.wsgi [None req-c0c8c7c3-758f-401a-a985-c1b1b528590e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-c0c8c7c3-758f-401a-a985-c1b1b528590e admin admin] Request method failure captured: Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Accept: application/json Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Accept-Encoding: gzip, deflate Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Connection: keep-alive Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Content-Length: 0 Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Host: 10.222.0.109 Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Openstack-Api-Version: compute 2.90 Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Openstack-System-Scope: None Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: User-Agent: python-novaclient Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Auth-Token: gAAAAABi7ES4z7z8dmGZqGie5XreGS4Qjnt_X0CNmMSheBRcdOqpyHkO9YOlhc3Z8fh55vWMD7DOJtETK3ktes3Fx1lZynZvMunTaCQAr7b9Zz94qozFPDKT-PDAHlX3kTHXCtCVOAcfsDkA2EYA9o3vJDDfVK5hUEAZu2WIhurbwyQ5pUms63U Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Domain-Id: None Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Domain-Name: None Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Identity-Status: Confirmed Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Is-Admin-Project: True Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Project-Domain-Id: default Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Project-Domain-Name: Default Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Project-Id: ee8a7cb4ed304a5598e10ca71a963013 Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Project-Name: admin Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Role: member,admin,reader Aug 04 22:14:16.898478 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Roles: member,admin,reader Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/ee8a7cb4ed304a5598e10ca71a963013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_ee8a7cb4ed304a5598e10ca71a963013", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ee8a7cb4ed304a5598e10ca71a963013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ee8a7cb4ed304a5598e10ca71a963013"}]}] Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Tenant: admin Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Tenant-Id: ee8a7cb4ed304a5598e10ca71a963013 Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Tenant-Name: admin Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User: admin Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User-Domain-Id: default Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User-Domain-Name: Default Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User-Id: f59916fe4d6d4a6aac1fc1ff790ac163 Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User-Name: admin Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: method: > Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: exception: Flavor 84 could not be found. Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: action_args: {'id': '84'} Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:14:16.899997 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:14:16.900861 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:16.901990 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-c0c8c7c3-758f-401a-a985-c1b1b528590e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:14:16.902999 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-c0c8c7c3-758f-401a-a985-c1b1b528590e admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.395310 Aug 04 22:14:16.902999 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 23/44] 10.222.0.109 () {60 vars in 1195 bytes} [Thu Aug 4 22:14:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 22:14:16.909647 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-b59051c4-3287-4abd-8214-a8955675150f admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:16.924572 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-b59051c4-3287-4abd-8214-a8955675150f admin admin] 10.222.0.109 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018681 Aug 04 22:14:16.925086 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 22/45] 10.222.0.109 () {60 vars in 1215 bytes} [Thu Aug 4 22:14:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:14:16.935009 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-25234606-0b5d-47e7-808a-25ee50438182 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:16.952057 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-25234606-0b5d-47e7-808a-25ee50438182 admin admin] 10.222.0.109 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.020568 Aug 04 22:14:16.952586 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 24/46] 10.222.0.109 () {60 vars in 1215 bytes} [Thu Aug 4 22:14:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:14:16.961842 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-77c404ce-5f8c-4f79-b226-4802db6b0ecd admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:16.967109 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.wsgi [None req-77c404ce-5f8c-4f79-b226-4802db6b0ecd admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-77c404ce-5f8c-4f79-b226-4802db6b0ecd admin admin] Request method failure captured: Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Accept: application/json Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Accept-Encoding: gzip, deflate Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Connection: keep-alive Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Content-Length: 0 Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Host: 10.222.0.109 Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Openstack-Api-Version: compute 2.90 Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Openstack-System-Scope: None Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: User-Agent: python-novaclient Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Auth-Token: gAAAAABi7ES4z7z8dmGZqGie5XreGS4Qjnt_X0CNmMSheBRcdOqpyHkO9YOlhc3Z8fh55vWMD7DOJtETK3ktes3Fx1lZynZvMunTaCQAr7b9Zz94qozFPDKT-PDAHlX3kTHXCtCVOAcfsDkA2EYA9o3vJDDfVK5hUEAZu2WIhurbwyQ5pUms63U Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Domain-Id: None Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Domain-Name: None Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Identity-Status: Confirmed Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Is-Admin-Project: True Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Project-Domain-Id: default Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Project-Domain-Name: Default Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Project-Id: ee8a7cb4ed304a5598e10ca71a963013 Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Project-Name: admin Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Role: member,admin,reader Aug 04 22:14:16.968592 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Roles: member,admin,reader Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/ee8a7cb4ed304a5598e10ca71a963013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_ee8a7cb4ed304a5598e10ca71a963013", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ee8a7cb4ed304a5598e10ca71a963013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ee8a7cb4ed304a5598e10ca71a963013"}]}] Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Tenant: admin Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Tenant-Id: ee8a7cb4ed304a5598e10ca71a963013 Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Tenant-Name: admin Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User: admin Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User-Domain-Id: default Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User-Domain-Name: Default Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User-Id: f59916fe4d6d4a6aac1fc1ff790ac163 Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User-Name: admin Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: method: > Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: exception: Flavor 84 could not be found. Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: action_args: {'id': '84'} Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:14:16.970213 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:14:16.971181 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:16.972718 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-77c404ce-5f8c-4f79-b226-4802db6b0ecd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:14:16.973982 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-77c404ce-5f8c-4f79-b226-4802db6b0ecd admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011677 Aug 04 22:14:16.973982 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 23/47] 10.222.0.109 () {60 vars in 1195 bytes} [Thu Aug 4 22:14:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 22:14:17.942562 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-25234606-0b5d-47e7-808a-25ee50438182 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:17.943970 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-25234606-0b5d-47e7-808a-25ee50438182 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001420 Aug 04 22:14:17.944095 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 25/48] 10.222.0.109 () {56 vars in 1079 bytes} [Thu Aug 4 22:14:17 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:14:18.471761 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-ed4e814d-b3fd-4404-9b4e-407ec4380097 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:18.477630 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.wsgi [None req-ed4e814d-b3fd-4404-9b4e-407ec4380097 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-ed4e814d-b3fd-4404-9b4e-407ec4380097 admin admin] Request method failure captured: Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Accept: application/json Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Accept-Encoding: gzip, deflate Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Connection: keep-alive Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Content-Length: 0 Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Host: 10.222.0.109 Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Openstack-Api-Version: compute 2.90 Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Openstack-System-Scope: None Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: User-Agent: python-novaclient Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Auth-Token: gAAAAABi7ES563w4Uz86RlX2BRY_uiJA3K9lYO4d9yS1UPXHqa2NqPrWf4cnACOkBfGk4dXdM1wSAjA_wSkfRPQ2z0npUkCLqGJLNlNaD9MP3WPmUuvYmZ4Uw7dxF8KfwnTJ1Rk_DLRlyuvCOsIqXiDm7n4ZoJDI-zDZU5wx_fmvgAEnl9sdvW4 Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Domain-Id: None Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Domain-Name: None Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Identity-Status: Confirmed Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Is-Admin-Project: True Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Project-Domain-Id: default Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Project-Domain-Name: Default Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Project-Id: ee8a7cb4ed304a5598e10ca71a963013 Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Project-Name: admin Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Role: member,admin,reader Aug 04 22:14:18.479117 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Roles: member,admin,reader Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/ee8a7cb4ed304a5598e10ca71a963013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_ee8a7cb4ed304a5598e10ca71a963013", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ee8a7cb4ed304a5598e10ca71a963013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ee8a7cb4ed304a5598e10ca71a963013"}]}] Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Tenant: admin Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Tenant-Id: ee8a7cb4ed304a5598e10ca71a963013 Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-Tenant-Name: admin Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User: admin Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User-Domain-Id: default Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User-Domain-Name: Default Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User-Id: f59916fe4d6d4a6aac1fc1ff790ac163 Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: X-User-Name: admin Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: method: > Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: exception: Flavor 451 could not be found. Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: action_args: {'id': '451'} Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:14:18.480855 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:14:18.482124 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: ERROR nova.api.openstack.wsgi Aug 04 22:14:18.483478 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-ed4e814d-b3fd-4404-9b4e-407ec4380097 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:14:18.484757 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-ed4e814d-b3fd-4404-9b4e-407ec4380097 admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.400137 Aug 04 22:14:18.484757 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 24/49] 10.222.0.109 () {60 vars in 1198 bytes} [Thu Aug 4 22:14:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 22:14:18.490096 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-692bffab-5433-4184-86ec-11e07f58593d admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:18.505658 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-692bffab-5433-4184-86ec-11e07f58593d admin admin] 10.222.0.109 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019072 Aug 04 22:14:18.507287 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 26/50] 10.222.0.109 () {60 vars in 1215 bytes} [Thu Aug 4 22:14:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:14:18.516780 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:18.531816 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] 10.222.0.109 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018521 Aug 04 22:14:18.532371 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 25/51] 10.222.0.109 () {60 vars in 1215 bytes} [Thu Aug 4 22:14:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:14:18.541824 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-a644e78b-9ed3-4ccc-914a-ae6e81772ce6 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:18.547060 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.wsgi [None req-a644e78b-9ed3-4ccc-914a-ae6e81772ce6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-a644e78b-9ed3-4ccc-914a-ae6e81772ce6 admin admin] Request method failure captured: Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Accept: application/json Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Accept-Encoding: gzip, deflate Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Connection: keep-alive Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Content-Length: 0 Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Host: 10.222.0.109 Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Openstack-Api-Version: compute 2.90 Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Openstack-System-Scope: None Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: User-Agent: python-novaclient Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Auth-Token: gAAAAABi7ES563w4Uz86RlX2BRY_uiJA3K9lYO4d9yS1UPXHqa2NqPrWf4cnACOkBfGk4dXdM1wSAjA_wSkfRPQ2z0npUkCLqGJLNlNaD9MP3WPmUuvYmZ4Uw7dxF8KfwnTJ1Rk_DLRlyuvCOsIqXiDm7n4ZoJDI-zDZU5wx_fmvgAEnl9sdvW4 Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Domain-Id: None Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Domain-Name: None Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Identity-Status: Confirmed Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Is-Admin-Project: True Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Project-Domain-Id: default Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Project-Domain-Name: Default Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Project-Id: ee8a7cb4ed304a5598e10ca71a963013 Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Project-Name: admin Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Role: member,admin,reader Aug 04 22:14:18.548541 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Roles: member,admin,reader Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/ee8a7cb4ed304a5598e10ca71a963013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_ee8a7cb4ed304a5598e10ca71a963013", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ee8a7cb4ed304a5598e10ca71a963013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ee8a7cb4ed304a5598e10ca71a963013"}]}] Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Tenant: admin Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Tenant-Id: ee8a7cb4ed304a5598e10ca71a963013 Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-Tenant-Name: admin Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User: admin Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User-Domain-Id: default Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User-Domain-Name: Default Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User-Id: f59916fe4d6d4a6aac1fc1ff790ac163 Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: X-User-Name: admin Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: method: > Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: exception: Flavor 451 could not be found. Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: action_args: {'id': '451'} Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:14:18.550123 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:14:18.550956 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: ERROR nova.api.openstack.wsgi Aug 04 22:14:18.552079 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-a644e78b-9ed3-4ccc-914a-ae6e81772ce6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:14:18.554193 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-a644e78b-9ed3-4ccc-914a-ae6e81772ce6 admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011552 Aug 04 22:14:18.554193 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 27/52] 10.222.0.109 () {60 vars in 1198 bytes} [Thu Aug 4 22:14:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 22:14:19.523971 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:19.524987 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001451 Aug 04 22:14:19.525383 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 26/53] 10.222.0.109 () {56 vars in 1079 bytes} [Thu Aug 4 22:14:19 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:14:20.045463 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-d3ae7306-719b-4ee9-b8e5-4f719a451652 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:14:20.064206 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-d3ae7306-719b-4ee9-b8e5-4f719a451652 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.399595 Aug 04 22:14:20.064750 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 28/54] 10.222.0.109 () {64 vars in 1240 bytes} [Thu Aug 4 22:14:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 22:14:21.031850 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:21.032848 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001431 Aug 04 22:14:21.033261 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 27/55] 10.222.0.109 () {56 vars in 1079 bytes} [Thu Aug 4 22:14:21 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:14:21.567805 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-56f9cade-62e3-48ac-b623-e2cba5e89c44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:14:21.586367 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-56f9cade-62e3-48ac-b623-e2cba5e89c44 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.414212 Aug 04 22:14:21.586895 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 29/56] 10.222.0.109 () {64 vars in 1240 bytes} [Thu Aug 4 22:14:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:14:22.567366 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:22.569008 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001429 Aug 04 22:14:22.569425 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 28/57] 10.222.0.109 () {56 vars in 1079 bytes} [Thu Aug 4 22:14:22 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:14:23.101771 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-57807f1c-d17f-4889-b36d-5ef63d8e2892 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:14:23.120863 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-57807f1c-d17f-4889-b36d-5ef63d8e2892 admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.411879 Aug 04 22:14:23.121402 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 30/58] 10.222.0.109 () {64 vars in 1240 bytes} [Thu Aug 4 22:14:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:14:24.100847 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:24.101928 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001512 Aug 04 22:14:24.102331 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 29/59] 10.222.0.109 () {56 vars in 1079 bytes} [Thu Aug 4 22:14:24 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:14:24.632965 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-56a1b4e8-74e9-4322-8000-083bad86eade admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:14:24.651869 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-56a1b4e8-74e9-4322-8000-083bad86eade admin admin] 10.222.0.109 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.406007 Aug 04 22:14:24.652422 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 31/60] 10.222.0.109 () {64 vars in 1240 bytes} [Thu Aug 4 22:14:24 2022] POST /compute/v2.1/flavors => generated 411 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 22:14:25.623493 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:25.624532 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001470 Aug 04 22:14:25.624926 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 30/61] 10.222.0.109 () {56 vars in 1079 bytes} [Thu Aug 4 22:14:25 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:14:26.149927 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-85121971-3dba-458c-8049-71a96245975e admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:14:26.170396 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-85121971-3dba-458c-8049-71a96245975e admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.406178 Aug 04 22:14:26.170930 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 32/62] 10.222.0.109 () {60 vars in 1207 bytes} [Thu Aug 4 22:14:25 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:15:18.012624 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:15:18.013694 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-987ab9d8-2fcc-46c1-8198-f3fb2f018695 admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001441 Aug 04 22:15:18.014094 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 31/63] 10.222.0.109 () {54 vars in 936 bytes} [Thu Aug 4 22:15:18 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:15:18.025231 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:18.407050 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-897f1d18-f4fa-4af9-ac39-9c8d0f67d043 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:15:18.427729 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-897f1d18-f4fa-4af9-ac39-9c8d0f67d043 admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.406934 Aug 04 22:15:18.428257 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 33/64] 10.222.0.109 () {60 vars in 1297 bytes} [Thu Aug 4 22:15:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:15:18.452454 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-8704d5b9-1fb7-46bf-8e1a-1cccaacd795c admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:15:18.455913 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG dbcounter [-] [114715] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=114715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:18.461809 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-8704d5b9-1fb7-46bf-8e1a-1cccaacd795c admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012916 Aug 04 22:15:18.462320 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 32/65] 10.222.0.109 () {60 vars in 1288 bytes} [Thu Aug 4 22:15:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:15:18.473853 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-5b47a363-9235-43d1-a7b4-29917449f589 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:15:18.481422 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-5b47a363-9235-43d1-a7b4-29917449f589 admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011137 Aug 04 22:15:18.482235 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 34/66] 10.222.0.109 () {60 vars in 1291 bytes} [Thu Aug 4 22:15:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:15:18.494338 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-eb12042d-cc04-4633-90ad-eef82178461d admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:15:18.502276 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-eb12042d-cc04-4633-90ad-eef82178461d admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011815 Aug 04 22:15:18.502790 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 33/67] 10.222.0.109 () {60 vars in 1291 bytes} [Thu Aug 4 22:15:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:15:18.515093 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-07f57499-f271-4990-87cd-82bd8429afe1 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:15:18.522986 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-07f57499-f271-4990-87cd-82bd8429afe1 admin admin] 10.222.0.109 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011425 Aug 04 22:15:18.523529 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 35/68] 10.222.0.109 () {60 vars in 1288 bytes} [Thu Aug 4 22:15:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:18:15.301943 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-eb12042d-cc04-4633-90ad-eef82178461d admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:18:15.302981 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-eb12042d-cc04-4633-90ad-eef82178461d admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001513 Aug 04 22:18:15.303374 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 34/69] 10.222.0.109 () {56 vars in 1079 bytes} [Thu Aug 4 22:18:15 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:18:15.451436 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writing DB stats nova_api:SELECT=6 {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:15.611106 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-a87e8300-b3f6-48e3-99e7-7986ea453822 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:18:15.613544 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:18:15.613544 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: warnings.warn(msg) Aug 04 22:18:15.614674 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-a87e8300-b3f6-48e3-99e7-7986ea453822 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:18:15.615166 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-a87e8300-b3f6-48e3-99e7-7986ea453822 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:18:15.615601 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-a87e8300-b3f6-48e3-99e7-7986ea453822 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:18:15.616320 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-a87e8300-b3f6-48e3-99e7-7986ea453822 admin admin] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:18:15.616776 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-a87e8300-b3f6-48e3-99e7-7986ea453822 admin admin] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:18:15.617198 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-a87e8300-b3f6-48e3-99e7-7986ea453822 admin admin] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:18:15.660569 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-a87e8300-b3f6-48e3-99e7-7986ea453822 admin admin] 10.222.0.109 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.214084 Aug 04 22:18:15.661135 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 36/70] 10.222.0.109 () {60 vars in 1198 bytes} [Thu Aug 4 22:18:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:18:16.485334 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-eb12042d-cc04-4633-90ad-eef82178461d admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:18:16.486367 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-eb12042d-cc04-4633-90ad-eef82178461d admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001443 Aug 04 22:18:16.486767 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 35/71] 10.222.0.109 () {56 vars in 1079 bytes} [Thu Aug 4 22:18:16 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:18:16.677630 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-3738393c-d393-4b5f-bcac-0a542f5b7d64 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:18:16.679968 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:18:16.679968 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: warnings.warn(msg) Aug 04 22:18:16.681054 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-3738393c-d393-4b5f-bcac-0a542f5b7d64 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:18:16.681553 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-3738393c-d393-4b5f-bcac-0a542f5b7d64 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:18:16.681976 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-3738393c-d393-4b5f-bcac-0a542f5b7d64 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:18:16.682679 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-3738393c-d393-4b5f-bcac-0a542f5b7d64 admin admin] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:18:16.683122 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-3738393c-d393-4b5f-bcac-0a542f5b7d64 admin admin] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:18:16.683531 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-3738393c-d393-4b5f-bcac-0a542f5b7d64 admin admin] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:18:16.703191 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-3738393c-d393-4b5f-bcac-0a542f5b7d64 admin admin] 10.222.0.109 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076937 Aug 04 22:18:16.703656 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 37/72] 10.222.0.109 () {60 vars in 1198 bytes} [Thu Aug 4 22:18:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:18:28.105143 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-eb12042d-cc04-4633-90ad-eef82178461d admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:18:28.106193 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-eb12042d-cc04-4633-90ad-eef82178461d admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001844 Aug 04 22:18:28.106590 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 36/73] 10.222.0.109 () {56 vars in 1079 bytes} [Thu Aug 4 22:18:28 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:18:28.255958 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writing DB stats nova_cell0:SELECT=4 {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:28.256673 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writing DB stats nova_cell1:SELECT=4 {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:28.257371 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG dbcounter [-] [114714] Writing DB stats nova_api:SELECT=8 {{(pid=114714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:28.306285 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-bb90d69a-66ee-4da1-b86a-1320ef5d2745 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:18:28.308727 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:18:28.308727 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: warnings.warn(msg) Aug 04 22:18:28.309843 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-bb90d69a-66ee-4da1-b86a-1320ef5d2745 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:18:28.310344 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-bb90d69a-66ee-4da1-b86a-1320ef5d2745 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:18:28.310766 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-bb90d69a-66ee-4da1-b86a-1320ef5d2745 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:18:28.311528 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-bb90d69a-66ee-4da1-b86a-1320ef5d2745 admin admin] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:18:28.311914 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-bb90d69a-66ee-4da1-b86a-1320ef5d2745 admin admin] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:18:28.312325 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-bb90d69a-66ee-4da1-b86a-1320ef5d2745 admin admin] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:18:28.336941 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-bb90d69a-66ee-4da1-b86a-1320ef5d2745 admin admin] 10.222.0.109 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085801 Aug 04 22:18:28.337491 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 38/74] 10.222.0.109 () {60 vars in 1198 bytes} [Thu Aug 4 22:18:28 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:18:29.158804 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: DEBUG nova.api.openstack.wsgi [None req-eb12042d-cc04-4633-90ad-eef82178461d admin admin] Calling method '>' {{(pid=114715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:18:29.159802 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: INFO nova.api.openstack.requestlog [None req-eb12042d-cc04-4633-90ad-eef82178461d admin admin] 10.222.0.109 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001423 Aug 04 22:18:29.160206 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: [pid: 114715|app: 0|req: 37/75] 10.222.0.109 () {56 vars in 1079 bytes} [Thu Aug 4 22:18:29 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:18:29.351791 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG nova.api.openstack.wsgi [None req-3b65364a-4306-4c00-8f2a-db2e7794a012 admin admin] Calling method '>' {{(pid=114714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:18:29.354190 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:18:29.354190 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: warnings.warn(msg) Aug 04 22:18:29.355575 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-3b65364a-4306-4c00-8f2a-db2e7794a012 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:18:29.356065 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-3b65364a-4306-4c00-8f2a-db2e7794a012 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:18:29.356492 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-3b65364a-4306-4c00-8f2a-db2e7794a012 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:18:29.357206 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-3b65364a-4306-4c00-8f2a-db2e7794a012 admin admin] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:18:29.357682 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-3b65364a-4306-4c00-8f2a-db2e7794a012 admin admin] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:18:29.358095 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: DEBUG oslo_concurrency.lockutils [None req-3b65364a-4306-4c00-8f2a-db2e7794a012 admin admin] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:18:29.379924 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: INFO nova.api.openstack.requestlog [None req-3b65364a-4306-4c00-8f2a-db2e7794a012 admin admin] 10.222.0.109 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080264 Aug 04 22:18:29.380722 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: [pid: 114714|app: 0|req: 39/76] 10.222.0.109 () {60 vars in 1198 bytes} [Thu Aug 4 22:18:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:19:25.656261 dv-cinder-852211-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 22:19:25.656973 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: Thu Aug 4 22:19:25 2022 - graceful shutdown triggered... Aug 04 22:19:25.657501 dv-cinder-852211-1-iscsi devstack@n-api.service[114714]: Gracefully killing worker 1 (pid: 114714)... Aug 04 22:19:25.657885 dv-cinder-852211-1-iscsi devstack@n-api.service[114715]: Gracefully killing worker 2 (pid: 114715)... Aug 04 22:19:26.658179 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: worker 1 buried after 1 seconds Aug 04 22:19:26.658179 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: worker 2 buried after 1 seconds Aug 04 22:19:26.658179 dv-cinder-852211-1-iscsi devstack@n-api.service[114713]: goodbye to uWSGI. Aug 04 22:19:26.659643 dv-cinder-852211-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 22:19:26.660197 dv-cinder-852211-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 22:19:26.663086 dv-cinder-852211-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 22:19:26.672527 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 22:19:26.675083 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 22:19:26 2022] *** Aug 04 22:19:26.675258 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 22:19:26.675395 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 22:19:26.675606 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: nodename: dv-cinder-852211-1-iscsi Aug 04 22:19:26.675727 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: machine: x86_64 Aug 04 22:19:26.675838 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: clock source: unix Aug 04 22:19:26.675954 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: pcre jit disabled Aug 04 22:19:26.676066 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: detected number of CPU cores: 4 Aug 04 22:19:26.676176 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: current working directory: / Aug 04 22:19:26.676285 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: detected binary path: /usr/bin/uwsgi-core Aug 04 22:19:26.676429 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: your processes number limit is 47680 Aug 04 22:19:26.676542 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: your memory page size is 4096 bytes Aug 04 22:19:26.676653 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: detected max file descriptor number: 2048 Aug 04 22:19:26.676770 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: lock engine: pthread robust mutexes Aug 04 22:19:26.677050 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: thunder lock: enabled Aug 04 22:19:26.677370 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 22:19:26.678517 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 22:19:26.721194 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: Python main interpreter initialized at 0x558c4daa69c0 Aug 04 22:19:26.721194 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: python threads support enabled Aug 04 22:19:26.721194 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: your server socket listen backlog is limited to 100 connections Aug 04 22:19:26.721194 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: your mercy for graceful operations on workers is 90 seconds Aug 04 22:19:26.721666 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 22:19:26.721666 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: *** Operational MODE: preforking *** Aug 04 22:19:26.721933 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: *** uWSGI is running in multiple interpreter mode *** Aug 04 22:19:26.721933 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: spawned uWSGI master process (pid: 129175) Aug 04 22:19:26.722138 dv-cinder-852211-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 22:19:26.723456 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: spawned uWSGI worker 1 (pid: 129196, cores: 1) Aug 04 22:19:26.723981 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: spawned uWSGI worker 2 (pid: 129197, cores: 1) Aug 04 22:19:26.724126 dv-cinder-852211-1-iscsi devstack@n-api.service[129175]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 22:19:27.395213 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 22:19:27.399094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 22:19:28.569965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 22:19:28.569965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: from cryptography.utils import int_from_bytes Aug 04 22:19:28.570585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 22:19:28.570585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: from cryptography.utils import int_from_bytes Aug 04 22:19:28.571578 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 22:19:28.571578 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: from cryptography.utils import int_from_bytes Aug 04 22:19:28.572021 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 22:19:28.572021 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: from cryptography.utils import int_from_bytes Aug 04 22:19:30.883483 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 22:19:30.884066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 22:19:30.884336 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 22:19:30.884600 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 22:19:30.885054 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 22:19:30.885467 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.885792 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.886297 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.886763 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.887101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.887413 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.887734 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.888052 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.888382 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.888643 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.888956 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.889286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-1-iscsi {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.889650 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.889944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.890251 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.890568 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.890873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.891195 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.891511 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.892008 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.892452 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.892762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.893071 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.893453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.893845 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.894153 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.894473 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.894783 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.895104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.895413 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.895808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-1-iscsi {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.896125 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.896480 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.897291 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.897735 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.898045 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.898353 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.898673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.898995 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.899300 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.899630 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.899949 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.900266 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.900585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.900887 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.901194 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.901535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.901845 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.902150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.902452 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.902702 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.903007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.903330 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.903653 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.903969 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.904223 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.904472 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.904793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.905113 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.905505 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.905749 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.906055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.906360 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.906663 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.906966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.907272 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.907577 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.907814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 22:19:30.908223 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.908313 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 22:19:30.908387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.908595 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 22:19:30.908706 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.908899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.909024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 22:19:30.909222 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 22:19:30.909328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.909646 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.109 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.909765 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.909943 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.109 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.910048 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.910222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.910328 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.910562 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.910683 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.910880 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.910990 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.911188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.911288 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.911505 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.911612 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.911822 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.911920 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.912193 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.912357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.912465 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.912806 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.913513 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.913694 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-1-iscsi {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.913831 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.913972 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.914100 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.914216 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.914387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.914510 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.914628 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.914628 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.914867 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.914986 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.915122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.915234 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.915351 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.915480 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.915595 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.915712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.915832 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.915961 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.916230 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.916379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.916524 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.916647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.916760 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.916878 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.917001 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.917114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.917424 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.917586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.917757 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.917906 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.918061 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.918219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.918394 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.918640 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.918803 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.918954 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.919115 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.919261 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.919429 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.919585 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-1-iscsi {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.919758 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.919914 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.920067 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.920211 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.920356 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.920508 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.920670 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.920670 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.920955 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.921109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.921273 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.921456 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.921611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.921765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.921919 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.922074 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.922233 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.922379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.922523 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.922675 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.922822 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.922976 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.923129 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.923337 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.923495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.923648 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.923810 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.923965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.924110 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.924261 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.924406 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.924556 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.924710 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.924861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.925008 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.925159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.925325 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.925503 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.925664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.925818 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.925970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.926125 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.926438 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.926600 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.926764 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.926921 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.926921 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.927216 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.927378 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.927625 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.927782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.927927 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.927927 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.928216 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.928361 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.928523 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.928766 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.928918 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.929063 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.929215 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.929215 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.929627 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.929775 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.929932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.930084 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.930239 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.930394 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.930539 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.930684 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.930834 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.930980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.931130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.931299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.931452 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.931604 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.931759 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.931759 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.932051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.932051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.932350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.932495 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.932649 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.932795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.933012 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.933171 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.933382 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.109 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.933553 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.933713 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.109 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.933861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.934020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.934177 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.934330 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.934492 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.934645 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.934796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.934950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.935096 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.935240 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.935402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.935556 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.935713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.935867 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.936019 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.936172 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.936346 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.936637 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.936802 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.936948 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.937107 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.937252 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.937424 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.937612 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.937842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.938006 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.938155 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.938306 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.938461 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.938608 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.938784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.939028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.939028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.939310 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.939461 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.939626 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.939785 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.939937 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.940091 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.940242 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.940397 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.940555 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.940717 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.940862 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.941006 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.941150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.941300 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.941549 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.941739 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.941889 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.942041 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.942187 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.942339 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.942498 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.942651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.942808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.942962 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.943108 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.943108 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.943924 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.944084 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.944249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.944403 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.944559 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.944760 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.944908 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.945053 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.945206 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.945358 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.945543 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.945702 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.945859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.946006 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.946164 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.946348 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.946771 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.946937 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.947087 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.947238 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.947238 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.947534 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.947692 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.947867 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.948097 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.948247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.948398 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.948577 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.948730 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.948882 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.949045 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.949279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.949458 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.949625 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.949778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.949923 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.950067 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.950218 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.950363 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.950518 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.950682 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.950834 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.950979 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.951122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.951320 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.951480 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.951627 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.951811 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.951984 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.952139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.952295 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.952440 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.952584 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.952738 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.952882 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.953033 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.953187 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.953334 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.953522 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.953678 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.953836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.954021 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.954189 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.954339 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.954492 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.954638 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.954799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.954952 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:19:30.955110 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.955264 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.955410 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.955555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.955699 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.955856 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.956008 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.956153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.956307 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.956462 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.956623 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.956923 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.957076 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.957222 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.957375 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.957551 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.957699 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.957859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.958014 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.958248 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.958401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.958401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.958703 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.958861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.959801 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.959968 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.960123 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.960270 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.960430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.960593 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.960739 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.960883 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.961034 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.961179 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.961454 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.961626 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.961782 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.961988 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.962176 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.962358 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.962549 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.962704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.962704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.962987 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.963139 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.963304 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.963450 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.963450 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.963751 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.963897 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.964086 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.964252 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.964409 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.964562 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.964706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.964859 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.965004 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.965166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.965311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.965483 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.965635 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.965798 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.965953 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.966116 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.966263 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.966408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.966558 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.966718 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.967043 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.967208 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.967362 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.967515 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.967673 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.967832 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.968010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.968171 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.968422 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.968590 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.968825 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.968983 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.969148 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.969301 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.969484 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.969654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.969824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.970073 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.970240 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.970415 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.970575 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.970734 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.970892 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.971051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.971217 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.971376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.971529 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.971679 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.971837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.972002 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.972156 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.972318 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.972476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.972628 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.972778 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.972942 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.973101 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.973254 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.973463 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.973626 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.973778 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.973940 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.974139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.974310 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.974479 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.974838 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.975111 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.975315 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.975477 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.975630 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.975781 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.975939 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.976104 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.976263 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.976423 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.976583 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.976736 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.976901 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.976901 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.977378 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.977556 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.977721 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.977872 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.978023 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.978023 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.978338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.978338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.978733 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.978886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.979036 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.979208 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.979361 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.979513 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.979664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.979821 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.979986 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.980247 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.980413 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.980566 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.980718 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.980868 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.981028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.981188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.981355 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.981531 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.981685 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.981874 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.982045 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.982198 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.982198 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.982493 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.982646 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.982797 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.982963 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.983122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.983286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.983436 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.983586 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.983751 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.983910 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.984061 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.984256 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.984424 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.984585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.984771 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.984934 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.985085 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.985236 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.985398 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.985586 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.985751 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.985905 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.986064 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.986429 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.986597 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.986757 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.986921 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.987074 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.987392 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.987552 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.987711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.987883 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.988045 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.988198 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.988349 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.988499 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.988745 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.988915 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.989075 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.989228 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.989386 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.989563 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.989716 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.989883 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.990049 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.990317 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.990674 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.990865 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.991022 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.991183 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.991343 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.991501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.991501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.991797 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.991949 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.992115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.992279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.992437 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.992596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.992755 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.992987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.993151 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.993310 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.993533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.993693 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.993852 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.994013 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.994166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.994360 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.994527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.994678 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.994837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.995003 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.995201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.995357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.995508 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.995658 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.995808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.995968 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.996127 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.996280 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.996437 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.996437 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.996748 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.996748 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.997060 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.997060 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.997522 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.997682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.997847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.998000 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.998150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.998308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.998461 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.998619 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.998886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.999055 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.999220 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.999382 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.999541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.999703 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:30.999863 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.000014 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.000165 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.000325 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.000485 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.000664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.000916 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.001078 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.001232 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.001397 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.001630 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.001630 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.001930 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.002081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.002238 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.002399 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.002552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.002703 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.002853 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.003278 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.003430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.003595 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.003746 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.003952 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.004110 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.004276 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.004489 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.004649 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.004800 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.004959 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.005112 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.005269 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.005463 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.005631 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.006299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.006467 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.006619 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.006778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.007028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.007200 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.007363 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.007695 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.007863 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.008026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.008180 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.008351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.008512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.008672 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.008851 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.009096 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.009260 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.009432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.009603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.009756 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.009924 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.010090 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.010250 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.010425 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.010585 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.010736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.010922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.011176 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.011334 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.011493 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.011647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.011798 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.011959 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.012120 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.012281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.012432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.012604 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.012757 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.012757 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.013058 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.013210 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.013370 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.013561 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.013714 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.013878 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.014038 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.014208 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.014361 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.014555 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.014729 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.014729 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.015041 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.015203 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.015362 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.015522 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.015688 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.015848 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.016008 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.016169 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.016328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.016328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.016625 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.016788 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.016949 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.017109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.017270 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.017443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.017634 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.017939 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.018093 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.018346 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.018504 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.018665 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.018886 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.019041 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.019302 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.019467 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.019620 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.019786 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.019953 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.020105 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.020257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.020416 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.020575 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.020735 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.020887 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.021046 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.021215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.022066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.022303 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.022615 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.022783 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.022944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.023096 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.023258 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.023410 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.023572 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.023732 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.023891 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.024042 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.024204 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.024204 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.024507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.024704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.024864 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.025023 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.025174 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.025338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.025338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.025691 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.025853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.026005 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.026166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.026340 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.026499 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.026659 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.026812 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.026968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.027121 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.027356 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.027713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.028035 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.028200 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.028352 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.028517 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.028517 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.028821 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.028821 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.029127 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.029127 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.029547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.029547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.029856 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.030007 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.030217 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.030376 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.030528 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.030679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.032109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.032915 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.033090 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.033257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.033694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.033872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.034029 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.034189 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.034535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.034920 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.035086 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.035239 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.035399 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.035716 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.035960 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.036116 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.036276 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.036428 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.036588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.036892 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.037102 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.037264 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.037527 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.037698 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.037852 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.038180 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.038357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.038519 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.038673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.038825 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.038977 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.039135 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.039311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.039474 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.039733 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.039892 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.040060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.040223 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.040387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.040540 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.040691 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.040691 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.040977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.041143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.041305 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.041554 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.041724 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.041877 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.042036 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.042199 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.042351 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.042502 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.042654 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.042812 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.043079 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.043253 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.043408 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.043571 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.043731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.043891 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.044059 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.044212 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.044371 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.044524 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.044675 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.044885 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.045056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.045217 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.045369 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.045564 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.045731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.045882 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.046047 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.046200 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.046350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.046509 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.046669 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.046829 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.046990 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.047142 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.047294 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.047459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.047612 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.047788 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.047942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.048126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.048442 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.048596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.048756 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.048919 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.049071 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.049230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.049383 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.049383 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.049870 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.050046 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.050211 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.050363 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.050523 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.050675 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.050830 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.050991 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.051153 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.051332 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.051606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.051799 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.052059 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.052305 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.052498 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.053201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.053479 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.053642 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.053642 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.054113 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.054283 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.054436 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.054588 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.054739 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.054946 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.055105 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.055256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.055420 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.055571 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.055730 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.055894 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.056048 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.056213 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.056374 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.056533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.056694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.056848 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.056998 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.057157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.057322 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.057522 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.057694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.057854 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.058025 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.058179 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.058503 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.058664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.058831 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.058984 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.059136 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.059303 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.059456 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.059624 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.059796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.060051 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.060224 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.060379 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.060538 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.060705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.060865 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.061018 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.061169 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.061329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.061526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.061695 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.061870 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.062031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.062184 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.062343 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.062495 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.062660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.062814 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.062966 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.063117 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.063268 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.063435 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.063687 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.063846 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.064014 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.064166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.064317 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.064483 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.064641 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.064800 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.064996 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.065155 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.065315 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.065503 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.065663 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.065822 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.065975 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.066147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.066300 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.066465 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.066621 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.066773 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.066924 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.067090 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.067243 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.067404 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.067565 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.067725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.067884 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.068049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.069315 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.069565 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.069735 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.069889 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.069996 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.070103 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.070320 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.070420 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.070507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.070600 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.070694 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.070781 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.070875 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.071008 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.071128 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.071241 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.071353 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.071473 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.071595 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.071716 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.071837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.071950 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.072061 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.072200 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.072370 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.072536 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.072689 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.072856 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.073031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.073184 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.073335 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.073523 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.073705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.073961 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.074130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.074291 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.074444 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.074596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.074761 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.074924 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.075128 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.075285 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.075436 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.075588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.075739 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.075899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.075899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.076208 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.076369 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.076529 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.076689 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.076865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.077026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.077178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.077330 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.077601 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.077763 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.077925 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.078087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.078248 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.078401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.078554 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.079351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.079666 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.079830 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.079830 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.080139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.080313 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.080551 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.080710 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.080863 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.081014 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.081166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.081326 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.081520 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.081686 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.081850 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.082003 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.082162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.082315 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.082481 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.082635 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.082795 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.082948 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.083107 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.083269 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.083429 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.083582 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.083734 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.083964 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.084215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.084387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.084542 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.084702 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.084878 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.085032 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.085228 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.085401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.085598 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.085759 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.085759 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.086049 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.086219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.086383 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.086538 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.086690 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.086858 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.087010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.087175 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.087336 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.087336 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.087625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.087791 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.087791 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.087791 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.087791 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.088382 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.088540 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.088711 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.088864 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.089025 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.089185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.089337 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.089526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.089830 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.089990 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.090154 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.090325 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.090486 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.090736 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.090901 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.091068 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.091221 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.091373 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.091525 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.091677 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.091828 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.092063 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.092229 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.092396 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.092547 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.092709 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.092861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.093026 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.093186 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.093346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.093572 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.093728 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.093894 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.094056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.094234 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.094478 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.094646 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.094810 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.094973 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.095126 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.095349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.095515 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.095668 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.095834 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.095989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.096148 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.096300 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.096467 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.096631 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.096793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.096954 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.097107 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.097257 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.097425 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.097595 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.097762 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.097923 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.098084 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.098236 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.098387 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.098560 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.098727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.098888 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.099055 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.099215 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.099367 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.099944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.100129 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.100293 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.100454 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.100608 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.100855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.101024 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.101204 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.101365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.101569 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.101738 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.101901 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.102068 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.102222 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.102374 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.102525 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.102683 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.102843 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.103005 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.103165 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.103331 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.103483 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.103643 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.103804 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.103965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.104117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.104277 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.104430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.104702 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.104702 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.105018 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.105172 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.105396 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.105586 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.105750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.105924 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.106091 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.106253 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.106409 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.106569 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.106724 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.106886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.107039 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.107191 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.107350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.107350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.107672 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.107825 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.107986 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.108138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.108303 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.108458 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.108631 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.108788 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.108940 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.109092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.109243 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.109394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.109616 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.109771 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.109948 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.110269 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.110422 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.110585 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.110739 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.111576 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.111745 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.111897 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.112006 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.112095 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.112181 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.112266 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.112359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.112445 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.112540 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.112636 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.112732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.112819 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.112903 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.112995 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.113091 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.113185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.113271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.113362 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.113476 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.113573 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.113674 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.113761 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.113855 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.113942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.114034 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.114129 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.114216 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.114216 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.114377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.114470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.114557 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.114651 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.114651 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.114898 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.114987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.115086 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.115985 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116918 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116918 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116918 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116918 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116918 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116918 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116918 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.116918 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.117572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.117572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.117572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.117572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.117572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.117572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.117572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.118731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.119464 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.119464 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.119464 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.119464 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.119464 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.119464 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.119464 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.119464 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.120069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.120069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.120069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.120069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.120419 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.120509 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.120509 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.120670 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.120756 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.120840 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.120939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.121252 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.121252 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.121488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.121593 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.121691 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.121778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.121778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.121952 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122045 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122132 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122226 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.122883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.123497 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.123497 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.123497 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.123497 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.123497 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.123881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.124014 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.124328 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.124648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.124960 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.125276 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.125579 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.125735 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.125922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.126035 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.126240 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.126445 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.126540 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.126732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.126888 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.127095 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.127206 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.127442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.127555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.127819 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.128322 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.128432 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.128656 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.128763 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.129004 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.129140 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.129330 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.129457 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.129714 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.129828 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.130478 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.130571 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.130660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.130734 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.130734 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.130923 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.131370 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.131686 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.131798 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.132003 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.132415 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.132507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.132589 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.132669 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.132757 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.132837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.133154 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.133257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.133341 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.133594 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.133685 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.133872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.133986 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.134168 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.134261 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.134445 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.134601 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.134755 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.134909 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.135071 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.135226 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.135345 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.135623 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.135794 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.135964 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.136128 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.136293 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.136445 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.136596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.136754 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.136913 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.137072 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.137236 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.137394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.137706 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.137882 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.138137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.138297 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.138555 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.138714 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.138866 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.139016 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.139177 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.139350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.139603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.140383 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.140550 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.140814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.140988 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.141180 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.141180 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.141515 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.142336 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.142508 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.142670 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.142839 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.142992 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.143150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.143312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.143312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.143491 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.143578 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.143664 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.143749 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.143834 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.143925 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.144025 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.144117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.144203 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.144288 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.144379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.144465 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.144465 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.144465 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.144706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.144841 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.145274 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.145392 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.145716 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.145870 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.146003 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.146101 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.146190 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.146885 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.147047 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.147145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.147304 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.147400 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.147619 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.147791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.147930 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.148026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.148248 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.148363 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.148632 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.148756 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.148887 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.148981 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.149200 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.149301 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.149549 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.149655 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.149844 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.150015 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.150157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.150259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.150468 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.150571 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.150778 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.150871 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.151087 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.151180 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.151399 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.151502 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.151711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.151960 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.152066 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.152317 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.152449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.152625 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.152769 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.152934 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.153085 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.153243 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.153400 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.153581 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.153742 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.153894 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.154064 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.154202 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.154369 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.154511 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.154684 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.154820 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.154993 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.155129 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.155307 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.155437 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.155617 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.155773 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.155928 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.156126 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.156222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.156430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.156563 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.156758 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.156904 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.157070 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.157224 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.157398 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.157581 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.157734 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.157889 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.158061 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.158216 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.158392 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.158531 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.158725 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.158844 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.159041 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.159145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.159378 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.159481 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.159695 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.160709 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.160709 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.160888 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.160971 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.161051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.161133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.161207 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.161277 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.161347 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.161579 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.161683 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.161915 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.162684 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.162811 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.163011 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.163103 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.163332 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.163434 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.163672 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.163764 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.164010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.164103 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.164327 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.164419 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.164660 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.164750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.164976 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.165074 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.165292 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.165393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.165633 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.165746 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.165951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.166079 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.166267 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.166352 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.166654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.166978 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.167294 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.167468 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.167628 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.167797 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.168109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.168275 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.168433 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.168598 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.168748 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.168908 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.169064 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.169214 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.169363 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.169563 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.169716 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.169864 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.170012 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.170246 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.170354 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.170442 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.170768 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.171088 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.171442 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.171669 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.171774 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.172089 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.172188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.172410 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.172503 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.172723 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.172866 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.172964 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 22:19:31.173149 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.173539 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.173882 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.174214 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.174541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.174858 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:19:31.175114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 22:19:31.327251 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO dbcounter [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] Registered counter for database nova_api Aug 04 22:19:31.330732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO dbcounter [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] Registered counter for database nova_api Aug 04 22:19:31.348044 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_db.sqlalchemy.engines [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:19:31.353642 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_db.sqlalchemy.engines [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:19:31.355998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writer thread running {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:19:31.360240 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writer thread running {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:19:31.413459 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.context [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cabbb7be-13c8-431a-acef-35fafb43c245(cell1) {{(pid=129197) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 22:19:31.417494 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:19:31.417675 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.context [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cabbb7be-13c8-431a-acef-35fafb43c245(cell1) {{(pid=129196) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 22:19:31.417973 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:19:31.419563 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:19:31.420283 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:19:31.420725 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:19:31.421704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:19:31.422190 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:19:31.422760 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:19:31.423791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:19:31.424530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:19:31.424741 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO dbcounter [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] Registered counter for database nova_cell0 Aug 04 22:19:31.424988 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:19:31.427230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:19:31.429010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO dbcounter [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] Registered counter for database nova_cell1 Aug 04 22:19:31.429288 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO dbcounter [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] Registered counter for database nova_cell0 Aug 04 22:19:31.433620 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO dbcounter [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] Registered counter for database nova_cell1 Aug 04 22:19:31.436916 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_db.sqlalchemy.engines [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:19:31.438477 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_db.sqlalchemy.engines [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:19:31.440608 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_db.sqlalchemy.engines [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:19:31.442871 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_db.sqlalchemy.engines [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:19:31.445571 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writer thread running {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:19:31.448097 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writer thread running {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:19:31.451200 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writer thread running {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:19:31.589112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writer thread running {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:19:31.595009 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO dbcounter [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] Registered counter for database nova_cell0 Aug 04 22:19:31.599277 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO dbcounter [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] Registered counter for database nova_cell0 Aug 04 22:19:31.602390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_db.sqlalchemy.engines [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:19:31.606949 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writer thread running {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:19:31.611704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_db.sqlalchemy.engines [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:19:31.616835 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writer thread running {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:19:31.942442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: WARNING keystonemiddleware.auth_token [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 22:19:31.943165 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: WARNING keystonemiddleware.auth_token [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 22:19:31.950405 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: WARNING keystonemiddleware.auth_token [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 22:19:31.951103 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: WARNING keystonemiddleware.auth_token [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 22:19:32.298095 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: WARNING keystonemiddleware.auth_token [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 22:19:32.303880 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: WARNING keystonemiddleware.auth_token [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 22:19:32.304688 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: WARNING keystonemiddleware.auth_token [None req-15ece0e3-f281-4a0e-8da0-69ad2e86b4ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 22:19:32.310249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: WARNING keystonemiddleware.auth_token [None req-63529752-4993-4545-bec2-a552e0fdb987 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 22:19:32.311487 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c4daa69c0 pid: 129196 (default app) Aug 04 22:19:32.316646 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c4daa69c0 pid: 129197 (default app) Aug 04 22:20:07.997451 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=3 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:08.008470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=3 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:08.010527 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=3 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:08.022885 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=3 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:08.366418 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=3 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:08.367991 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=3 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:08.368895 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=3 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:08.373858 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=3 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:09.600823 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5fa0c973-2f26-44cd-8093-37199e7c3cf5 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Action: 'create', calling method: .version_select at 0x7fe7b379fdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-412708249"}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:10.125005 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ab7d3471-671d-46a6-b424-9951df4fc33c tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Action: 'create', calling method: .version_select at 0x7fe7b379fdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2001412373", "metadata": {"Type": "work"}}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:12.005949 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5fa0c973-2f26-44cd-8093-37199e7c3cf5 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.031402 Aug 04 22:20:12.017074 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 1/1] 10.222.0.109 () {60 vars in 1160 bytes} [Thu Aug 4 22:20:07 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4044 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 04 22:20:12.023100 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b538ef44-3a12-456b-86e8-960df4c881a3 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b3618c10>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:12.299328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b538ef44-3a12-456b-86e8-960df4c881a3 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf" status: 200 len: 344 microversion: 2.1 time: 0.280831 Aug 04 22:20:12.299884 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 2/2] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:12 2022] GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf => generated 344 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:12.323069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ab7d3471-671d-46a6-b424-9951df4fc33c tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] 10.222.0.109 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.965467 Aug 04 22:20:12.334070 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 1/3] 10.222.0.109 () {60 vars in 1161 bytes} [Thu Aug 4 22:20:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3979 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 04 22:20:12.342797 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e7298635-3af6-4b05-8b72-42a19bd55515 tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Calling method '.version_select at 0x7fe7b3633310>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:12.418075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e7298635-3af6-4b05-8b72-42a19bd55515 tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee" status: 200 len: 353 microversion: 2.1 time: 0.082616 Aug 04 22:20:12.418638 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 3/4] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:12 2022] GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:13.315685 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-252a3167-9e55-4493-b46b-1581a2823013 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b368dc10>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:13.417981 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-252a3167-9e55-4493-b46b-1581a2823013 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf" status: 200 len: 345 microversion: 2.1 time: 0.108391 Aug 04 22:20:13.418808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 2/5] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:13 2022] GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:13.437452 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ebcefac1-7e0a-4dff-9d99-c20e0f720ff8 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Action: 'create', calling method: .version_select at 0x7fe7b362e310>, body: {"snapshot": {"volume_id": "35c4057b-28d6-4b2b-97ba-9de437c52dbf", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-796875823"}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:13.441069 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-900ecf67-f10c-4b24-b17e-fe41110f7d58 tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Calling method '.version_select at 0x7fe7b3633a60>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:13.543815 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-900ecf67-f10c-4b24-b17e-fe41110f7d58 tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee" status: 200 len: 353 microversion: 2.1 time: 0.112860 Aug 04 22:20:13.544645 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 4/6] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:13 2022] GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:14.252444 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ebcefac1-7e0a-4dff-9d99-c20e0f720ff8 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.822553 Aug 04 22:20:14.267292 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-bfc38d78-6278-4062-9624-5ce9ecbbe215 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b3618dc0>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:14.267942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 3/7] 10.222.0.109 () {60 vars in 1167 bytes} [Thu Aug 4 22:20:13 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:14.509598 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-bfc38d78-6278-4062-9624-5ce9ecbbe215 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05" status: 200 len: 286 microversion: 2.1 time: 0.246399 Aug 04 22:20:14.521749 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 5/8] 10.222.0.109 () {58 vars in 1256 bytes} [Thu Aug 4 22:20:14 2022] GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05 => generated 286 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:14.525062 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bc15c2d9-3dff-4315-9ef1-31497faeea7c tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b362c3a0>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:14.561193 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-cd4255ae-7b7e-45f4-a3b8-94cf3d1f160a tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Calling method '.version_select at 0x7fe7b3633af0>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:14.642759 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bc15c2d9-3dff-4315-9ef1-31497faeea7c tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.124012 Aug 04 22:20:14.651156 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 4/9] 10.222.0.109 () {58 vars in 1145 bytes} [Thu Aug 4 22:20:14 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:14.675964 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ee9121e7-0a4f-44a8-a30d-20294ebdd5ed tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b362e280>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:14.750608 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-cd4255ae-7b7e-45f4-a3b8-94cf3d1f160a tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee" status: 200 len: 354 microversion: 2.1 time: 0.193789 Aug 04 22:20:14.759290 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 6/10] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:14 2022] GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee => generated 354 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:14.764491 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-71de417c-89f8-4edd-bb3e-99fd464e32e9 tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Calling method '.version_select at 0x7fe7b3633310>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:14.810686 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ee9121e7-0a4f-44a8-a30d-20294ebdd5ed tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05" status: 200 len: 286 microversion: 2.1 time: 0.158139 Aug 04 22:20:14.818250 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 5/11] 10.222.0.109 () {58 vars in 1256 bytes} [Thu Aug 4 22:20:14 2022] GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:14.916519 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-71de417c-89f8-4edd-bb3e-99fd464e32e9 tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee" status: 200 len: 354 microversion: 2.1 time: 0.155807 Aug 04 22:20:14.918270 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 7/12] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:14 2022] GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:14.941231 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-5c818892-af75-4c0c-a3ae-efe85df245d0 tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Calling method '.version_select at 0x7fe7b368dc10>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:15.152590 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-5c818892-af75-4c0c-a3ae-efe85df245d0 tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] 10.222.0.109 "DELETE /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee" status: 202 len: 0 microversion: 2.1 time: 0.216101 Aug 04 22:20:15.156093 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 6/13] 10.222.0.109 () {58 vars in 1253 bytes} [Thu Aug 4 22:20:14 2022] DELETE /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:20:15.162901 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a0908b93-5edb-4018-bdcb-e0bbff51d9ef tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Calling method '.version_select at 0x7fe7b3633280>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:15.267008 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a0908b93-5edb-4018-bdcb-e0bbff51d9ef tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee" status: 200 len: 353 microversion: 2.1 time: 0.108795 Aug 04 22:20:15.267654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 8/14] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:15 2022] GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:15.828109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d8efa392-6acd-4898-a4fc-247fc2e22e3f tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b362c940>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:15.897770 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d8efa392-6acd-4898-a4fc-247fc2e22e3f tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05" status: 200 len: 286 microversion: 2.1 time: 0.077001 Aug 04 22:20:15.898592 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 7/15] 10.222.0.109 () {58 vars in 1256 bytes} [Thu Aug 4 22:20:15 2022] GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:16.280677 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-96a6f461-b397-431d-b86b-21a3c8a2b00a tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Calling method '.version_select at 0x7fe7b3633af0>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:16.438538 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-96a6f461-b397-431d-b86b-21a3c8a2b00a tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee" status: 200 len: 353 microversion: 2.1 time: 0.162015 Aug 04 22:20:16.439794 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 9/16] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:16 2022] GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee => generated 353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:16.912803 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-45ae2ee6-caa3-43a4-a59f-49b31c1343b6 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b3618b80>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:17.037081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-45ae2ee6-caa3-43a4-a59f-49b31c1343b6 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05" status: 200 len: 286 microversion: 2.1 time: 0.130492 Aug 04 22:20:17.037670 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 10/17] 10.222.0.109 () {58 vars in 1256 bytes} [Thu Aug 4 22:20:16 2022] GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:20:17.182316 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-5a6ef24f-d01a-4d66-805e-1c413531c5d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Action: 'create', calling method: .version_select at 0x7fe7b368dca0>, body: {"keypair": {"name": "tempest-keypair-2091670201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPjr5XqiehfLJhT8z1dsKRaSots9DzfDDUbvMZJD222UCk6r4QvkfsuiWQxWIBaxuAHgDLOddHvSNm9VQs7s9dDgDW/gfmc4fhVl6qn/MODZNH7AUH69ZgOUz4ex/dWAw=="}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:17.312720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-5a6ef24f-d01a-4d66-805e-1c413531c5d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Getting quotas for project 21d013d03bbc4f8ead46aca55d441eb1. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:20:17.335281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-5a6ef24f-d01a-4d66-805e-1c413531c5d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Getting quotas for user 8c0aa2b9a5ac46f9bede8d007dcd3504 and project 21d013d03bbc4f8ead46aca55d441eb1. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:20:17.461233 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a4f637c7-78fa-4f53-b273-6fbfd66b9ed1 tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Calling method '.version_select at 0x7fe7b3618af0>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:17.470994 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-5a6ef24f-d01a-4d66-805e-1c413531c5d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.617487 Aug 04 22:20:17.474603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 8/18] 10.222.0.109 () {62 vars in 1205 bytes} [Thu Aug 4 22:20:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 622 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 22:20:17.590329 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a4f637c7-78fa-4f53-b273-6fbfd66b9ed1 tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee" status: 200 len: 353 microversion: 2.1 time: 0.141408 Aug 04 22:20:17.591625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 11/19] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:17 2022] GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:18.052019 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c4173331-52c8-459a-bbd6-8fd03f3c41b0 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b360b9d0>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:18.110817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c4173331-52c8-459a-bbd6-8fd03f3c41b0 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05" status: 200 len: 286 microversion: 2.1 time: 0.063933 Aug 04 22:20:18.111805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 9/20] 10.222.0.109 () {58 vars in 1256 bytes} [Thu Aug 4 22:20:18 2022] GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:18.609270 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e1491fca-ae94-4ee4-9a27-7e7adf5877c5 tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Calling method '.version_select at 0x7fe7b3633af0>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:18.771915 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e1491fca-ae94-4ee4-9a27-7e7adf5877c5 tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee" status: 200 len: 353 microversion: 2.1 time: 0.171496 Aug 04 22:20:18.778525 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 12/21] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:18 2022] GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee => generated 353 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:19.126488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f3bd5ae2-43a2-472d-80db-4b3c31221af9 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b35b8790>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:19.235768 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f3bd5ae2-43a2-472d-80db-4b3c31221af9 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05" status: 200 len: 286 microversion: 2.1 time: 0.113950 Aug 04 22:20:19.237014 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 10/22] 10.222.0.109 () {58 vars in 1256 bytes} [Thu Aug 4 22:20:19 2022] GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05 => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:19.787021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-427fc388-5f00-425d-a245-53cc35c761eb tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Calling method '.version_select at 0x7fe7b3633280>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:19.900561 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-427fc388-5f00-425d-a245-53cc35c761eb tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee" status: 200 len: 353 microversion: 2.1 time: 0.118260 Aug 04 22:20:19.902952 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 13/23] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:19 2022] GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:20.249160 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-25f82e49-4797-4dea-ad3d-fcb18c5f6bc9 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b363e3a0>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:20.322446 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-761904892", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "networks": [{"uuid": "f9a77c92-4b5f-4958-a50f-c79964f93fac"}]}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:20.385028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-25f82e49-4797-4dea-ad3d-fcb18c5f6bc9 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05" status: 200 len: 286 microversion: 2.1 time: 0.138757 Aug 04 22:20:20.385879 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 14/24] 10.222.0.109 () {58 vars in 1256 bytes} [Thu Aug 4 22:20:20 2022] GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:20:20.610705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.network.neutron [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] validate_networks() for [('f9a77c92-4b5f-4958-a50f-c79964f93fac', None, None, None, None, None)] {{(pid=129197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:20:20.923278 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f8168b23-57b7-49d7-b37c-1521ba62dbea tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Calling method '.version_select at 0x7fe7b3618e50>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:21.043342 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f8168b23-57b7-49d7-b37c-1521ba62dbea tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee" status: 200 len: 353 microversion: 2.1 time: 0.130160 Aug 04 22:20:21.043978 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 15/25] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:20 2022] GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:21.400046 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9d8444dd-f750-4256-8b2e-e811c559f429 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b36335e0>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:21.492517 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9d8444dd-f750-4256-8b2e-e811c559f429 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05" status: 200 len: 287 microversion: 2.1 time: 0.097651 Aug 04 22:20:21.494627 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 16/26] 10.222.0.109 () {58 vars in 1256 bytes} [Thu Aug 4 22:20:21 2022] GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05 => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:21.509141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e31d6614-6cf0-4abb-b520-8ad2f94b349d tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b3633dc0>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:21.667151 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e31d6614-6cf0-4abb-b520-8ad2f94b349d tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "DELETE /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05" status: 202 len: 0 microversion: 2.1 time: 0.164960 Aug 04 22:20:21.667715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 17/27] 10.222.0.109 () {58 vars in 1259 bytes} [Thu Aug 4 22:20:21 2022] DELETE /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 22:20:21.681488 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8b3c62f2-7b1d-49b0-80ba-f69373e06b7d tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b363e670>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:21.752604 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8b3c62f2-7b1d-49b0-80ba-f69373e06b7d tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05" status: 200 len: 286 microversion: 2.1 time: 0.080411 Aug 04 22:20:21.753809 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 18/28] 10.222.0.109 () {58 vars in 1256 bytes} [Thu Aug 4 22:20:21 2022] GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:20:22.069989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-82f814fd-b8f6-44c0-be8e-0ac6091df0be tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Calling method '.version_select at 0x7fe7b3633f70>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:22.214807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-82f814fd-b8f6-44c0-be8e-0ac6091df0be tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] HTTP exception thrown: Volume 782f1788-ad5b-4e9a-b69a-117cf99b2dee could not be found. Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-82f814fd-b8f6-44c0-be8e-0ac6091df0be tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Request method failure captured: Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee HTTP/1.1 Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYYHaJPWxKm9-P5kunW7l6X70V4UPNDEXIoJqUflnCM2JOAUGUcfAg1A7ydtsCoqTb57KjhKHgI1_pSOCDYtmq_l1R68Z79uGvQpNF549BiDgXhhD3hQsogno5eStBR9AmLJy80n4ea4-wBiEmYtaJ6dOCqfMjXmB7bwEiHB6pXBko Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: c940df02ebff4e94bf0874df846db424 Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-VolumesGetTestJSON-1071333622 Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:20:22.220765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:20:22.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/c940df02ebff4e94bf0874df846db424"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_c940df02ebff4e94bf0874df846db424", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/c940df02ebff4e94bf0874df846db424"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/c940df02ebff4e94bf0874df846db424"}]}] Aug 04 22:20:22.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-VolumesGetTestJSON-1071333622 Aug 04 22:20:22.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: c940df02ebff4e94bf0874df846db424 Aug 04 22:20:22.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-VolumesGetTestJSON-1071333622 Aug 04 22:20:22.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-VolumesGetTestJSON-1071333622-project Aug 04 22:20:22.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:20:22.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:20:22.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: e6066712c4604dcfb7407d92230d33d3 Aug 04 22:20:22.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-VolumesGetTestJSON-1071333622-project Aug 04 22:20:22.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: Aug 04 22:20:22.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Volume 782f1788-ad5b-4e9a-b69a-117cf99b2dee could not be found. Aug 04 22:20:22.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': '782f1788-ad5b-4e9a-b69a-117cf99b2dee'} Aug 04 22:20:22.222131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 782f1788-ad5b-4e9a-b69a-117cf99b2dee could not be found. (HTTP 404) (Request-ID: req-685b198c-7e8c-4991-a4d7-285e252d3774) Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:22.223470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 22:20:22.224585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 782f1788-ad5b-4e9a-b69a-117cf99b2dee could not be found. Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 22:20:22.225736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 782f1788-ad5b-4e9a-b69a-117cf99b2dee could not be found. Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 782f1788-ad5b-4e9a-b69a-117cf99b2dee could not be found. Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-82f814fd-b8f6-44c0-be8e-0ac6091df0be tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] Returning 404 to user: Volume 782f1788-ad5b-4e9a-b69a-117cf99b2dee could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-82f814fd-b8f6-44c0-be8e-0ac6091df0be tempest-VolumesGetTestJSON-1071333622 tempest-VolumesGetTestJSON-1071333622-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee" status: 404 len: 109 microversion: 2.1 time: 0.168561 Aug 04 22:20:22.226899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 19/29] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:22 2022] GET /compute/v2.1/os-volumes/782f1788-ad5b-4e9a-b69a-117cf99b2dee => generated 109 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:20:22.770216 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-74dc11a6-584e-411f-86c3-544f66eee749 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b3fa0280>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:22.849514 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-74dc11a6-584e-411f-86c3-544f66eee749 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] HTTP exception thrown: Snapshot df69d204-96d8-4ee2-8266-ac40c2b31f05 could not be found. Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-74dc11a6-584e-411f-86c3-544f66eee749 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Request method failure captured: Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05 HTTP/1.1 Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYXzo-kcWEHuir-1R9YJmV2ydGt2HRRMi5W-LPKt4s4XX9-I_aSi6QCOvppEzoISKIYoPj7NNf6HgdFefFevI_IHRkn6p0QxuyN9970rMCsmmf1B9WSjKDlxpRuwKLP_0ClYQd3tZ-SSB09m1fuFx72xH1ZyhZg6m4pln2-HmbWdBs Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 7f5901777ea64cf995c5626bcc782115 Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1281232215 Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:20:22.852021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:20:22.853060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/7f5901777ea64cf995c5626bcc782115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_7f5901777ea64cf995c5626bcc782115", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/7f5901777ea64cf995c5626bcc782115"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/7f5901777ea64cf995c5626bcc782115"}]}] Aug 04 22:20:22.853060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1281232215 Aug 04 22:20:22.853060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 7f5901777ea64cf995c5626bcc782115 Aug 04 22:20:22.853060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1281232215 Aug 04 22:20:22.853060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-VolumesSnapshotsTestJSON-1281232215-project Aug 04 22:20:22.853060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:20:22.853060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:20:22.853060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: bb940b4935e54eeb9409fb02b05c5e02 Aug 04 22:20:22.853060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1281232215-project Aug 04 22:20:22.853060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: Aug 04 22:20:22.853060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Snapshot df69d204-96d8-4ee2-8266-ac40c2b31f05 could not be found. Aug 04 22:20:22.853060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'df69d204-96d8-4ee2-8266-ac40c2b31f05'} Aug 04 22:20:22.853060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot df69d204-96d8-4ee2-8266-ac40c2b31f05 could not be found. (HTTP 404) (Request-ID: req-87ac8838-04de-45eb-82c1-21b4782f1f12) Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.853782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 22:20:22.854614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot df69d204-96d8-4ee2-8266-ac40c2b31f05 could not be found. Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 22:20:22.855504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:20:22.856402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot df69d204-96d8-4ee2-8266-ac40c2b31f05 could not be found. Aug 04 22:20:22.856402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.856402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:22.856402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.856402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:22.856402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:20:22.856402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:20:22.856402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:20:22.856402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:20:22.856402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot df69d204-96d8-4ee2-8266-ac40c2b31f05 could not be found. Aug 04 22:20:22.856402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:20:22.856402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-74dc11a6-584e-411f-86c3-544f66eee749 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Returning 404 to user: Snapshot df69d204-96d8-4ee2-8266-ac40c2b31f05 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:20:22.856402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-74dc11a6-584e-411f-86c3-544f66eee749 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05" status: 404 len: 111 microversion: 2.1 time: 0.088549 Aug 04 22:20:22.860865 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 20/30] 10.222.0.109 () {58 vars in 1256 bytes} [Thu Aug 4 22:20:22 2022] GET /compute/v2.1/os-snapshots/df69d204-96d8-4ee2-8266-ac40c2b31f05 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 22:20:22.863009 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-cd792ffd-2574-4841-813f-3b26c9110203 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b363ed30>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:23.017430 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-cd792ffd-2574-4841-813f-3b26c9110203 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "DELETE /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf" status: 202 len: 0 microversion: 2.1 time: 0.158897 Aug 04 22:20:23.018718 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 21/31] 10.222.0.109 () {58 vars in 1253 bytes} [Thu Aug 4 22:20:22 2022] DELETE /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:20:23.027071 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7e5d5574-8424-4dd9-9d29-00ac6c866b9b tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b35a5430>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:23.127382 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7e5d5574-8424-4dd9-9d29-00ac6c866b9b tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf" status: 200 len: 344 microversion: 2.1 time: 0.104342 Aug 04 22:20:23.128482 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 22/32] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:23 2022] GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf => generated 344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:23.606820 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Flavor limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:20:23.607366 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Image limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:20:23.607921 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Flavor pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:20:23.608506 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Image pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:20:23.608924 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:20:23.627338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1583764423", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58b39d14-c9eb-4bd7-8ba8-cccc6c357f15"}], "security_groups": [{"name": "tempest-securitygroup--540728696"}], "key_name": "tempest-keypair-2091670201", "user_data": "}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:23.636419 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:23.637255 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:23.637980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:23.639263 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:23.639963 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:23.640730 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:23.693883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Getting quotas for project 721722d703af4087bf9bb3854966b482. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:20:23.707053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Getting quotas for user 84b6e8d7c0f94bd5a3ad5bf90386b34c and project 721722d703af4087bf9bb3854966b482. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:20:23.741766 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Going to run 1 instances... {{(pid=129197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:20:23.744791 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:20:23.881309 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a0bcd06d-5a9a-46c2-8209-30eb0232fb96 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.957980 Aug 04 22:20:23.885337 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 11/33] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:20:19 2022] POST /compute/v2.1/servers => generated 382 bytes in 3962 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:20:23.905748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-92b9c16b-9e62-49b9-8508-5ead9751acd1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:23.909825 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-92b9c16b-9e62-49b9-8508-5ead9751acd1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:24.036942 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.network.neutron [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] validate_networks() for [('58b39d14-c9eb-4bd7-8ba8-cccc6c357f15', None, None, None, None, None)] {{(pid=129196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:20:24.127821 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-92b9c16b-9e62-49b9-8508-5ead9751acd1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:24.177750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-92b9c16b-9e62-49b9-8508-5ead9751acd1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1218 microversion: 2.1 time: 0.284426 Aug 04 22:20:24.181132 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 12/34] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:23 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1218 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:24.198398 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9d5ffd13-66fc-4217-ac2b-786354ae854d tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b2cf4b80>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:24.367761 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9d5ffd13-66fc-4217-ac2b-786354ae854d tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf" status: 200 len: 344 microversion: 2.1 time: 0.183506 Aug 04 22:20:24.368380 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 13/35] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:24 2022] GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf => generated 344 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:25.201666 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4587f579-2a8b-4bfd-a0f0-c9a406c54bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:25.202283 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4587f579-2a8b-4bfd-a0f0-c9a406c54bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:25.542675 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4587f579-2a8b-4bfd-a0f0-c9a406c54bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:25.561920 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4587f579-2a8b-4bfd-a0f0-c9a406c54bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1218 microversion: 2.1 time: 0.361270 Aug 04 22:20:25.563287 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 14/36] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:25 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1218 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:25.578493 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-79de9843-764b-4653-bb0b-4fc2eb46a1df tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b2d07820>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:25.674892 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-79de9843-764b-4653-bb0b-4fc2eb46a1df tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf" status: 200 len: 344 microversion: 2.1 time: 0.108328 Aug 04 22:20:25.680126 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 15/37] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:25 2022] GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf => generated 344 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:25.707834 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Flavor limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:20:25.708404 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Image limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:20:25.709010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Flavor pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:20:25.709585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Image pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:20:25.710103 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:20:25.748977 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:25.749499 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:25.755630 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:25.756617 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:25.758258 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:25.761556 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:25.828143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Getting quotas for project 21d013d03bbc4f8ead46aca55d441eb1. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:20:25.844278 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Getting quotas for user 8c0aa2b9a5ac46f9bede8d007dcd3504 and project 21d013d03bbc4f8ead46aca55d441eb1. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:20:25.874182 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Going to run 1 instances... {{(pid=129196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:20:25.877707 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:20:26.097321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0f2180ee-ff90-418b-b652-24978ac8d8c7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 2.474775 Aug 04 22:20:26.098622 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 23/38] 10.222.0.109 () {62 vars in 1193 bytes} [Thu Aug 4 22:20:23 2022] POST /compute/v2.1/servers => generated 403 bytes in 2476 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 04 22:20:26.109198 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-71d6e24c-371c-423c-a8db-d919a8c085f0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:26.110090 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-71d6e24c-371c-423c-a8db-d919a8c085f0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:26.475402 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-71d6e24c-371c-423c-a8db-d919a8c085f0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:26.486423 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-71d6e24c-371c-423c-a8db-d919a8c085f0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:26.494766 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-71d6e24c-371c-423c-a8db-d919a8c085f0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:26.497946 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-71d6e24c-371c-423c-a8db-d919a8c085f0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1286 microversion: 2.20 time: 0.391920 Aug 04 22:20:26.499648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 16/39] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:26 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1286 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:26.590397 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4dc3b7ed-88a9-4442-867c-ec87269f65c3 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:26.591309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4dc3b7ed-88a9-4442-867c-ec87269f65c3 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:26.621727 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4dc3b7ed-88a9-4442-867c-ec87269f65c3 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:26.624917 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4dc3b7ed-88a9-4442-867c-ec87269f65c3 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:26.626410 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4dc3b7ed-88a9-4442-867c-ec87269f65c3 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:26.629548 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4dc3b7ed-88a9-4442-867c-ec87269f65c3 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:26.631181 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4dc3b7ed-88a9-4442-867c-ec87269f65c3 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:26.631853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4dc3b7ed-88a9-4442-867c-ec87269f65c3 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:26.692393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-93c8d76d-c02d-4178-90c4-ebd02d35cb0d tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b2d0de50>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:26.864673 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-93c8d76d-c02d-4178-90c4-ebd02d35cb0d tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf" status: 200 len: 344 microversion: 2.1 time: 0.176066 Aug 04 22:20:26.874047 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 17/40] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:26 2022] GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf => generated 344 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:27.491020 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4dc3b7ed-88a9-4442-867c-ec87269f65c3 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:27.526853 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bfc4cc03-cd9b-492f-9866-fc9eafdffe7c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:27.527793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bfc4cc03-cd9b-492f-9866-fc9eafdffe7c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:27.540427 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4dc3b7ed-88a9-4442-867c-ec87269f65c3 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1222 microversion: 2.1 time: 0.955927 Aug 04 22:20:27.575824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 24/41] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:26 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1222 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:27.699826 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bfc4cc03-cd9b-492f-9866-fc9eafdffe7c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:27.709750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bfc4cc03-cd9b-492f-9866-fc9eafdffe7c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:27.717929 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bfc4cc03-cd9b-492f-9866-fc9eafdffe7c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:27.719378 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bfc4cc03-cd9b-492f-9866-fc9eafdffe7c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1286 microversion: 2.20 time: 0.200888 Aug 04 22:20:27.725883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 18/42] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:27 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:27.882543 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d71e754a-61fb-4884-a844-a3f3586aa72e tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b2cf4e50>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:27.943214 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-d71e754a-61fb-4884-a844-a3f3586aa72e tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] HTTP exception thrown: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d71e754a-61fb-4884-a844-a3f3586aa72e tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Request method failure captured: Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf HTTP/1.1 Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYXzo-kcWEHuir-1R9YJmV2ydGt2HRRMi5W-LPKt4s4XX9-I_aSi6QCOvppEzoISKIYoPj7NNf6HgdFefFevI_IHRkn6p0QxuyN9970rMCsmmf1B9WSjKDlxpRuwKLP_0ClYQd3tZ-SSB09m1fuFx72xH1ZyhZg6m4pln2-HmbWdBs Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 7f5901777ea64cf995c5626bcc782115 Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1281232215 Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:20:27.947372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:20:27.948526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/7f5901777ea64cf995c5626bcc782115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_7f5901777ea64cf995c5626bcc782115", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/7f5901777ea64cf995c5626bcc782115"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/7f5901777ea64cf995c5626bcc782115"}]}] Aug 04 22:20:27.948526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1281232215 Aug 04 22:20:27.948526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 7f5901777ea64cf995c5626bcc782115 Aug 04 22:20:27.948526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1281232215 Aug 04 22:20:27.948526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-VolumesSnapshotsTestJSON-1281232215-project Aug 04 22:20:27.948526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:20:27.948526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:20:27.948526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: bb940b4935e54eeb9409fb02b05c5e02 Aug 04 22:20:27.948526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1281232215-project Aug 04 22:20:27.948526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: Aug 04 22:20:27.948526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:27.948526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '35c4057b-28d6-4b2b-97ba-9de437c52dbf'} Aug 04 22:20:27.948526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. (HTTP 404) (Request-ID: req-191a72b0-ced8-4c51-85fa-903aebc4afdd) Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:27.949199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 22:20:27.950582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 22:20:27.951616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d71e754a-61fb-4884-a844-a3f3586aa72e tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Returning 404 to user: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d71e754a-61fb-4884-a844-a3f3586aa72e tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf" status: 404 len: 109 microversion: 2.1 time: 0.070615 Aug 04 22:20:27.952533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 19/43] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:27 2022] GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 22:20:27.966763 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-27850ce7-1f5e-417a-84d3-e314e8c0d637 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b3f9f160>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:28.022457 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-27850ce7-1f5e-417a-84d3-e314e8c0d637 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] HTTP exception thrown: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-27850ce7-1f5e-417a-84d3-e314e8c0d637 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Request method failure captured: Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: DELETE /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf HTTP/1.1 Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYXzo-kcWEHuir-1R9YJmV2ydGt2HRRMi5W-LPKt4s4XX9-I_aSi6QCOvppEzoISKIYoPj7NNf6HgdFefFevI_IHRkn6p0QxuyN9970rMCsmmf1B9WSjKDlxpRuwKLP_0ClYQd3tZ-SSB09m1fuFx72xH1ZyhZg6m4pln2-HmbWdBs Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 7f5901777ea64cf995c5626bcc782115 Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1281232215 Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:20:28.024744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:20:28.025842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/7f5901777ea64cf995c5626bcc782115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_7f5901777ea64cf995c5626bcc782115", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/7f5901777ea64cf995c5626bcc782115"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/7f5901777ea64cf995c5626bcc782115"}]}] Aug 04 22:20:28.025842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1281232215 Aug 04 22:20:28.025842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 7f5901777ea64cf995c5626bcc782115 Aug 04 22:20:28.025842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1281232215 Aug 04 22:20:28.025842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-VolumesSnapshotsTestJSON-1281232215-project Aug 04 22:20:28.025842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:20:28.025842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:20:28.025842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: bb940b4935e54eeb9409fb02b05c5e02 Aug 04 22:20:28.025842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1281232215-project Aug 04 22:20:28.025842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: Aug 04 22:20:28.025842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:28.025842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '35c4057b-28d6-4b2b-97ba-9de437c52dbf'} Aug 04 22:20:28.025842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. (HTTP 404) (Request-ID: req-768e5205-44c6-4901-922d-14964660cc55) Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:28.026472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 22:20:28.027527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 22:20:28.028546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:20:28.029451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:28.029451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.029451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:28.029451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.029451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:28.029451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:20:28.029451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:20:28.029451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:20:28.029451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:20:28.029451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:28.029451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.032301 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-27850ce7-1f5e-417a-84d3-e314e8c0d637 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Returning 404 to user: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:20:28.034173 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-27850ce7-1f5e-417a-84d3-e314e8c0d637 tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "DELETE /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf" status: 404 len: 109 microversion: 2.1 time: 0.071513 Aug 04 22:20:28.038539 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 20/44] 10.222.0.109 () {58 vars in 1253 bytes} [Thu Aug 4 22:20:27 2022] DELETE /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:20:28.047705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-768f8aaf-06aa-46c1-b4c9-d2f02afc7e3f tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Calling method '.version_select at 0x7fe7b2cd5e50>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:28.128320 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-768f8aaf-06aa-46c1-b4c9-d2f02afc7e3f tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] HTTP exception thrown: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-768f8aaf-06aa-46c1-b4c9-d2f02afc7e3f tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Request method failure captured: Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf HTTP/1.1 Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYXzo-kcWEHuir-1R9YJmV2ydGt2HRRMi5W-LPKt4s4XX9-I_aSi6QCOvppEzoISKIYoPj7NNf6HgdFefFevI_IHRkn6p0QxuyN9970rMCsmmf1B9WSjKDlxpRuwKLP_0ClYQd3tZ-SSB09m1fuFx72xH1ZyhZg6m4pln2-HmbWdBs Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 7f5901777ea64cf995c5626bcc782115 Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1281232215 Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:20:28.131512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:20:28.132552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/7f5901777ea64cf995c5626bcc782115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_7f5901777ea64cf995c5626bcc782115", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/7f5901777ea64cf995c5626bcc782115"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/7f5901777ea64cf995c5626bcc782115"}]}] Aug 04 22:20:28.132552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1281232215 Aug 04 22:20:28.132552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 7f5901777ea64cf995c5626bcc782115 Aug 04 22:20:28.132552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1281232215 Aug 04 22:20:28.132552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-VolumesSnapshotsTestJSON-1281232215-project Aug 04 22:20:28.132552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:20:28.132552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:20:28.132552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: bb940b4935e54eeb9409fb02b05c5e02 Aug 04 22:20:28.132552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1281232215-project Aug 04 22:20:28.132552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: Aug 04 22:20:28.132552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:28.132552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '35c4057b-28d6-4b2b-97ba-9de437c52dbf'} Aug 04 22:20:28.132552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. (HTTP 404) (Request-ID: req-de8f8bf6-6a8e-43c6-8cbe-0af764b902ee) Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:28.133178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 22:20:28.134099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 22:20:28.136024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:20:28.138219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:28.138219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.138219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:20:28.138219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.138219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:20:28.138219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:20:28.138219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:20:28.138219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:20:28.138219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:20:28.138219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. Aug 04 22:20:28.138219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:20:28.138219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-768f8aaf-06aa-46c1-b4c9-d2f02afc7e3f tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] Returning 404 to user: Volume 35c4057b-28d6-4b2b-97ba-9de437c52dbf could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:20:28.138219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-768f8aaf-06aa-46c1-b4c9-d2f02afc7e3f tempest-VolumesSnapshotsTestJSON-1281232215 tempest-VolumesSnapshotsTestJSON-1281232215-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf" status: 404 len: 109 microversion: 2.1 time: 0.097878 Aug 04 22:20:28.143421 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 21/45] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:20:28 2022] GET /compute/v2.1/os-volumes/35c4057b-28d6-4b2b-97ba-9de437c52dbf => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 22:20:28.549974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1283856471", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:28.575741 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-42fa12d2-7071-4b9f-8b8a-6e014199db73 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:28.576852 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-42fa12d2-7071-4b9f-8b8a-6e014199db73 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:28.595250 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-42fa12d2-7071-4b9f-8b8a-6e014199db73 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:28.595817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-42fa12d2-7071-4b9f-8b8a-6e014199db73 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:28.597383 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-42fa12d2-7071-4b9f-8b8a-6e014199db73 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:28.599615 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-42fa12d2-7071-4b9f-8b8a-6e014199db73 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:28.601920 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-42fa12d2-7071-4b9f-8b8a-6e014199db73 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:28.602576 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-42fa12d2-7071-4b9f-8b8a-6e014199db73 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:28.673588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.network.neutron [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] validate_networks() for [('da0530bc-1426-4242-a934-503023b6de69', None, None, None, None, None)] {{(pid=129196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:20:29.207307 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-42fa12d2-7071-4b9f-8b8a-6e014199db73 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:29.241198 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-42fa12d2-7071-4b9f-8b8a-6e014199db73 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1276 microversion: 2.1 time: 0.670438 Aug 04 22:20:29.259259 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 22/46] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:28 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1276 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:30.009237 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-8b849239-eda6-475a-933b-07cb77705e88 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Action: 'create', calling method: .version_select at 0x7fe7b1c00700>, body: {"keypair": {"name": "tempest-keypair-2071018194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLujfiUpSogSnKhBttF33h8B5/Xyt6JH6nXh8/mEAIFPoknzwU2kBxwQJyIMOHuByqAkWPXFNb0Uu37Mna9jgBDrR/TsmZWAp4tYITmA9d+22lumeht5QrTGSOFZaSLPLQ=="}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:30.060547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-8b849239-eda6-475a-933b-07cb77705e88 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for project 011b296da6654fa38f76eadd7bebae6f. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:20:30.080981 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-8b849239-eda6-475a-933b-07cb77705e88 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for user 8c50160e51b54cde9a3f617d71fbf1c0 and project 011b296da6654fa38f76eadd7bebae6f. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:20:30.189087 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-8b849239-eda6-475a-933b-07cb77705e88 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.924755 Aug 04 22:20:30.202789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 23/47] 10.222.0.109 () {60 vars in 1164 bytes} [Thu Aug 4 22:20:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:30.227203 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-94eb2431-ce5c-4252-b838-8f0e4788f0aa tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:30.228341 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-94eb2431-ce5c-4252-b838-8f0e4788f0aa tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:30.247129 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-94eb2431-ce5c-4252-b838-8f0e4788f0aa tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:30.250019 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-94eb2431-ce5c-4252-b838-8f0e4788f0aa tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:30.250982 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-94eb2431-ce5c-4252-b838-8f0e4788f0aa tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:30.254446 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-94eb2431-ce5c-4252-b838-8f0e4788f0aa tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:30.259471 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-94eb2431-ce5c-4252-b838-8f0e4788f0aa tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:30.260155 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-94eb2431-ce5c-4252-b838-8f0e4788f0aa tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:30.502891 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-94eb2431-ce5c-4252-b838-8f0e4788f0aa tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:30.516129 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-94eb2431-ce5c-4252-b838-8f0e4788f0aa tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:30.518249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-94eb2431-ce5c-4252-b838-8f0e4788f0aa tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:30.522617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-94eb2431-ce5c-4252-b838-8f0e4788f0aa tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1344 microversion: 2.20 time: 0.317051 Aug 04 22:20:30.526247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 24/48] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:30 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1344 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:30.534747 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-26721638-c795-4c0e-b5b3-852117da4201 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:30.536757 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-26721638-c795-4c0e-b5b3-852117da4201 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:30.556807 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26721638-c795-4c0e-b5b3-852117da4201 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:30.557624 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26721638-c795-4c0e-b5b3-852117da4201 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:30.559462 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26721638-c795-4c0e-b5b3-852117da4201 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:30.563374 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26721638-c795-4c0e-b5b3-852117da4201 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:30.564121 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26721638-c795-4c0e-b5b3-852117da4201 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:30.564954 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26721638-c795-4c0e-b5b3-852117da4201 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:32.008551 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Flavor limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:20:32.013189 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Image limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:20:32.013947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Flavor pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:20:32.015141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Image pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:20:32.015785 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:20:32.042644 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:32.046819 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:32.052780 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:32.055104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:32.056146 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:32.058550 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:32.134681 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Getting quotas for project 5116986e2edc4b5c92da0b77a497910a. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:20:32.154461 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Getting quotas for user f3dab07011da408c97ed90d58f2c155b and project 5116986e2edc4b5c92da0b77a497910a. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:20:32.198484 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Going to run 1 instances... {{(pid=129196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:20:32.200868 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:20:32.384923 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6bc2b48a-7cb4-4a23-9a78-2c57c5437112 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 4.804812 Aug 04 22:20:32.393640 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 25/49] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:20:27 2022] POST /compute/v2.1/servers => generated 385 bytes in 4814 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:20:32.402724 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5e1c2f94-c761-4b87-9446-b0bd39846f8c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:32.404395 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5e1c2f94-c761-4b87-9446-b0bd39846f8c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:32.419008 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5e1c2f94-c761-4b87-9446-b0bd39846f8c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:32.420606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5e1c2f94-c761-4b87-9446-b0bd39846f8c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:32.421284 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5e1c2f94-c761-4b87-9446-b0bd39846f8c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:32.422267 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5e1c2f94-c761-4b87-9446-b0bd39846f8c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:32.432874 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5e1c2f94-c761-4b87-9446-b0bd39846f8c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:32.435976 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5e1c2f94-c761-4b87-9446-b0bd39846f8c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:32.729716 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-26721638-c795-4c0e-b5b3-852117da4201 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:32.744141 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-26721638-c795-4c0e-b5b3-852117da4201 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 2.216511 Aug 04 22:20:32.754960 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 25/50] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:30 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:32.783137 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-13efb7ad-b426-4ccb-863b-52250c666682 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:32.783923 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-13efb7ad-b426-4ccb-863b-52250c666682 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:33.167388 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-13efb7ad-b426-4ccb-863b-52250c666682 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:33.187119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-13efb7ad-b426-4ccb-863b-52250c666682 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1226 microversion: 2.1 time: 0.430417 Aug 04 22:20:33.193017 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 26/51] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:32 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1226 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:33.697457 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1937423949", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:33.733716 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:33.914461 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.network.neutron [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] validate_networks() for [('da0530bc-1426-4242-a934-503023b6de69', None, None, None, None, None)] {{(pid=129197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:20:34.130195 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5e1c2f94-c761-4b87-9446-b0bd39846f8c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:34.151440 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5e1c2f94-c761-4b87-9446-b0bd39846f8c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:34.173553 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5e1c2f94-c761-4b87-9446-b0bd39846f8c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:34.182674 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5e1c2f94-c761-4b87-9446-b0bd39846f8c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 1.785082 Aug 04 22:20:34.183299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 26/52] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:32 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:34.230998 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-829d8cf9-c95c-4749-a9e7-c58bf5e57724 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:34.231676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-829d8cf9-c95c-4749-a9e7-c58bf5e57724 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:34.278054 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-829d8cf9-c95c-4749-a9e7-c58bf5e57724 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:34.278527 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-829d8cf9-c95c-4749-a9e7-c58bf5e57724 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:34.278964 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-829d8cf9-c95c-4749-a9e7-c58bf5e57724 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:34.279679 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-829d8cf9-c95c-4749-a9e7-c58bf5e57724 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:34.280139 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-829d8cf9-c95c-4749-a9e7-c58bf5e57724 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:34.298190 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-829d8cf9-c95c-4749-a9e7-c58bf5e57724 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:35.346599 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-829d8cf9-c95c-4749-a9e7-c58bf5e57724 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:35.359582 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-829d8cf9-c95c-4749-a9e7-c58bf5e57724 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 1.154761 Aug 04 22:20:35.360206 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 27/53] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:34 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:35.396317 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4b9da550-9c44-4817-9da8-96e090a5c62b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:35.400733 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4b9da550-9c44-4817-9da8-96e090a5c62b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:35.422138 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4b9da550-9c44-4817-9da8-96e090a5c62b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:35.427872 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4b9da550-9c44-4817-9da8-96e090a5c62b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:35.428582 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4b9da550-9c44-4817-9da8-96e090a5c62b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:35.432375 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4b9da550-9c44-4817-9da8-96e090a5c62b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:35.437084 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4b9da550-9c44-4817-9da8-96e090a5c62b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:35.437914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4b9da550-9c44-4817-9da8-96e090a5c62b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:36.671949 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4b9da550-9c44-4817-9da8-96e090a5c62b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:36.680328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4b9da550-9c44-4817-9da8-96e090a5c62b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:36.681881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4b9da550-9c44-4817-9da8-96e090a5c62b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:36.693500 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4b9da550-9c44-4817-9da8-96e090a5c62b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 1.314859 Aug 04 22:20:36.694097 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 28/54] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:35 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:36.735528 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4799d1f0-7cff-49e6-b87a-bc153a25ac41 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:36.736774 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4799d1f0-7cff-49e6-b87a-bc153a25ac41 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:36.783392 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4799d1f0-7cff-49e6-b87a-bc153a25ac41 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:36.785759 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4799d1f0-7cff-49e6-b87a-bc153a25ac41 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:36.789050 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4799d1f0-7cff-49e6-b87a-bc153a25ac41 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:36.790334 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4799d1f0-7cff-49e6-b87a-bc153a25ac41 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:36.797429 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4799d1f0-7cff-49e6-b87a-bc153a25ac41 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:36.800752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4799d1f0-7cff-49e6-b87a-bc153a25ac41 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:37.605902 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4799d1f0-7cff-49e6-b87a-bc153a25ac41 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:37.616782 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Flavor limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:20:37.618230 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Image limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:20:37.619043 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Flavor pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:20:37.619635 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Image pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:20:37.620507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:20:37.623891 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4799d1f0-7cff-49e6-b87a-bc153a25ac41 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.918880 Aug 04 22:20:37.627391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 29/55] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:36 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:37.649837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:37.651719 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:37.652401 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:37.654081 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:37.655842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:37.658184 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:37.699908 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Getting quotas for project 5116986e2edc4b5c92da0b77a497910a. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:20:37.711218 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Getting quotas for user f3dab07011da408c97ed90d58f2c155b and project 5116986e2edc4b5c92da0b77a497910a. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:20:37.738426 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Going to run 1 instances... {{(pid=129197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:20:37.740955 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:20:37.849812 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c1bf2afc-3fc4-42e9-aafb-86026f10a1ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 4.183367 Aug 04 22:20:37.865026 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 27/56] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:20:33 2022] POST /compute/v2.1/servers => generated 385 bytes in 4194 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:20:37.869996 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f09447e8-661c-427c-9f3d-0ece5009fa79 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:37.882112 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f09447e8-661c-427c-9f3d-0ece5009fa79 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:37.919539 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f09447e8-661c-427c-9f3d-0ece5009fa79 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:37.920065 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f09447e8-661c-427c-9f3d-0ece5009fa79 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:37.920524 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f09447e8-661c-427c-9f3d-0ece5009fa79 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:37.921242 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f09447e8-661c-427c-9f3d-0ece5009fa79 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:37.921730 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f09447e8-661c-427c-9f3d-0ece5009fa79 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:37.922154 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f09447e8-661c-427c-9f3d-0ece5009fa79 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:38.355104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-0285372e-6104-4cb6-9dc0-c2ec0bd1be9a req-c65b4d61-9e17-49e0-a77b-dacbf68ed661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09", "tag": "1d5ab153-937c-4016-8c27-0e52680db3c0"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:38.430982 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-0285372e-6104-4cb6-9dc0-c2ec0bd1be9a req-c65b4d61-9e17-49e0-a77b-dacbf68ed661 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:38.436557 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-0285372e-6104-4cb6-9dc0-c2ec0bd1be9a req-c65b4d61-9e17-49e0-a77b-dacbf68ed661 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:38.437135 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-0285372e-6104-4cb6-9dc0-c2ec0bd1be9a req-c65b4d61-9e17-49e0-a77b-dacbf68ed661 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:38.531371 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-0285372e-6104-4cb6-9dc0-c2ec0bd1be9a req-c65b4d61-9e17-49e0-a77b-dacbf68ed661 service nova] Creating event network-changed:1d5ab153-937c-4016-8c27-0e52680db3c0 for instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 on hv-cinder-85221 Aug 04 22:20:38.534436 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-0285372e-6104-4cb6-9dc0-c2ec0bd1be9a req-c65b4d61-9e17-49e0-a77b-dacbf68ed661 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129196) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 22:20:38.537321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-0285372e-6104-4cb6-9dc0-c2ec0bd1be9a req-c65b4d61-9e17-49e0-a77b-dacbf68ed661 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129196) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 22:20:38.539244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-38f6c34d-81af-4ba2-9019-97edb75642b4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:38.544466 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-38f6c34d-81af-4ba2-9019-97edb75642b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:38.546060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-38f6c34d-81af-4ba2-9019-97edb75642b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:38.548918 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-38f6c34d-81af-4ba2-9019-97edb75642b4 None None] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:38.549777 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-38f6c34d-81af-4ba2-9019-97edb75642b4 None None] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:38.552645 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-38f6c34d-81af-4ba2-9019-97edb75642b4 None None] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:38.588798 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.compute.rpcapi [None req-38f6c34d-81af-4ba2-9019-97edb75642b4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 22:20:38.594363 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-38f6c34d-81af-4ba2-9019-97edb75642b4 None None] Releasing lock "compute-rpcapi-router" {{(pid=129196) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 22:20:38.639476 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-38f6c34d-81af-4ba2-9019-97edb75642b4 None None] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.004301 Aug 04 22:20:38.641346 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 30/57] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:38.653099 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7d1a5038-e38d-425e-adc4-ab73022239ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:38.656705 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7d1a5038-e38d-425e-adc4-ab73022239ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:38.766784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7d1a5038-e38d-425e-adc4-ab73022239ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:38.784149 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7d1a5038-e38d-425e-adc4-ab73022239ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1226 microversion: 2.1 time: 0.140971 Aug 04 22:20:38.785341 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 31/58] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:38 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1226 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:38.794132 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-194e044b-ceb5-40bb-9de9-989fbe1cd434 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:38.795084 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-194e044b-ceb5-40bb-9de9-989fbe1cd434 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:38.803054 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-194e044b-ceb5-40bb-9de9-989fbe1cd434 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:38.804163 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-194e044b-ceb5-40bb-9de9-989fbe1cd434 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:38.807704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-194e044b-ceb5-40bb-9de9-989fbe1cd434 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:38.809845 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-194e044b-ceb5-40bb-9de9-989fbe1cd434 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:38.810985 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-194e044b-ceb5-40bb-9de9-989fbe1cd434 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:38.811803 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-194e044b-ceb5-40bb-9de9-989fbe1cd434 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:39.664304 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-194e044b-ceb5-40bb-9de9-989fbe1cd434 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:39.686300 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-194e044b-ceb5-40bb-9de9-989fbe1cd434 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.897374 Aug 04 22:20:39.689566 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 32/59] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:38 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:39.819053 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9f26d0d9-acaf-4604-a9af-4ff810cde283 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:39.820287 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9f26d0d9-acaf-4604-a9af-4ff810cde283 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:39.845709 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f26d0d9-acaf-4604-a9af-4ff810cde283 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:39.847269 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f26d0d9-acaf-4604-a9af-4ff810cde283 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:39.848463 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f26d0d9-acaf-4604-a9af-4ff810cde283 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:39.849892 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f26d0d9-acaf-4604-a9af-4ff810cde283 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:39.851002 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f26d0d9-acaf-4604-a9af-4ff810cde283 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:39.852206 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f26d0d9-acaf-4604-a9af-4ff810cde283 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:40.131942 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9f26d0d9-acaf-4604-a9af-4ff810cde283 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:40.145884 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9f26d0d9-acaf-4604-a9af-4ff810cde283 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1222 microversion: 2.1 time: 0.338044 Aug 04 22:20:40.151051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 33/60] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:39 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1222 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:40.708793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7207a1a0-694f-489f-b650-fe417e9b6345 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:40.709633 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7207a1a0-694f-489f-b650-fe417e9b6345 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:40.722926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7207a1a0-694f-489f-b650-fe417e9b6345 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:40.733525 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7207a1a0-694f-489f-b650-fe417e9b6345 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:40.734372 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7207a1a0-694f-489f-b650-fe417e9b6345 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:40.738920 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7207a1a0-694f-489f-b650-fe417e9b6345 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:40.740549 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7207a1a0-694f-489f-b650-fe417e9b6345 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:40.741206 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7207a1a0-694f-489f-b650-fe417e9b6345 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:40.792675 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f09447e8-661c-427c-9f3d-0ece5009fa79 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:40.814031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f09447e8-661c-427c-9f3d-0ece5009fa79 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:40.830615 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f09447e8-661c-427c-9f3d-0ece5009fa79 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:40.838661 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f09447e8-661c-427c-9f3d-0ece5009fa79 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 2.977904 Aug 04 22:20:40.842952 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 28/61] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:37 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 2983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:41.171584 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-11971550-393e-4c30-b859-3f41df9dda2c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:41.172594 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-11971550-393e-4c30-b859-3f41df9dda2c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:41.174927 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=8 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:41.198047 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-11971550-393e-4c30-b859-3f41df9dda2c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:41.209001 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-11971550-393e-4c30-b859-3f41df9dda2c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:41.210163 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-11971550-393e-4c30-b859-3f41df9dda2c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:41.212161 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-11971550-393e-4c30-b859-3f41df9dda2c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:41.214257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-11971550-393e-4c30-b859-3f41df9dda2c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:41.214920 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-11971550-393e-4c30-b859-3f41df9dda2c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:41.718653 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-11971550-393e-4c30-b859-3f41df9dda2c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:41.738955 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-11971550-393e-4c30-b859-3f41df9dda2c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1286 microversion: 2.1 time: 0.568921 Aug 04 22:20:41.756137 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 29/62] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:41 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1286 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:41.950636 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-527225e3-fd7c-480f-861e-8b388b4dd9b7 req-e058aa7b-d3fc-467a-ac03-001302f8f7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb440660-4715-48f6-a7ff-f0b74dfefe21", "tag": "417dd402-4a58-49ce-a237-c5d14b0ce44d"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:42.000352 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-527225e3-fd7c-480f-861e-8b388b4dd9b7 req-e058aa7b-d3fc-467a-ac03-001302f8f7a4 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:42.000852 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-527225e3-fd7c-480f-861e-8b388b4dd9b7 req-e058aa7b-d3fc-467a-ac03-001302f8f7a4 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:42.001288 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-527225e3-fd7c-480f-861e-8b388b4dd9b7 req-e058aa7b-d3fc-467a-ac03-001302f8f7a4 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:42.044736 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-527225e3-fd7c-480f-861e-8b388b4dd9b7 req-e058aa7b-d3fc-467a-ac03-001302f8f7a4 service nova] Creating event network-changed:417dd402-4a58-49ce-a237-c5d14b0ce44d for instance eb440660-4715-48f6-a7ff-f0b74dfefe21 on hv-cinder-85221 Aug 04 22:20:42.053267 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-527225e3-fd7c-480f-861e-8b388b4dd9b7 req-e058aa7b-d3fc-467a-ac03-001302f8f7a4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129197) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 22:20:42.053267 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-527225e3-fd7c-480f-861e-8b388b4dd9b7 req-e058aa7b-d3fc-467a-ac03-001302f8f7a4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129197) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 22:20:42.053267 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8f65ea6-a1a7-4adc-9caf-516f2f0dd21b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:42.053267 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8f65ea6-a1a7-4adc-9caf-516f2f0dd21b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:42.053267 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8f65ea6-a1a7-4adc-9caf-516f2f0dd21b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:42.053791 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8f65ea6-a1a7-4adc-9caf-516f2f0dd21b None None] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:42.053867 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8f65ea6-a1a7-4adc-9caf-516f2f0dd21b None None] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:42.054266 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8f65ea6-a1a7-4adc-9caf-516f2f0dd21b None None] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:42.084560 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.compute.rpcapi [None req-d8f65ea6-a1a7-4adc-9caf-516f2f0dd21b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 22:20:42.085482 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8f65ea6-a1a7-4adc-9caf-516f2f0dd21b None None] Releasing lock "compute-rpcapi-router" {{(pid=129197) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 22:20:42.140028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d8f65ea6-a1a7-4adc-9caf-516f2f0dd21b None None] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.382331 Aug 04 22:20:42.142958 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 30/63] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:42.155859 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7207a1a0-694f-489f-b650-fe417e9b6345 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:42.157114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4690fb9a-690f-4347-b425-f9237fb24074 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:42.158470 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4690fb9a-690f-4347-b425-f9237fb24074 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:42.165803 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7207a1a0-694f-489f-b650-fe417e9b6345 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 1.461657 Aug 04 22:20:42.178593 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4690fb9a-690f-4347-b425-f9237fb24074 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:42.182652 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4690fb9a-690f-4347-b425-f9237fb24074 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:42.183328 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4690fb9a-690f-4347-b425-f9237fb24074 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:42.184985 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4690fb9a-690f-4347-b425-f9237fb24074 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:42.185159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 34/64] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:40 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:42.187805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4690fb9a-690f-4347-b425-f9237fb24074 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:42.188557 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4690fb9a-690f-4347-b425-f9237fb24074 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:42.765477 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7b7e8f40-f46e-44f1-a09d-68f501c60a5a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:42.766456 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7b7e8f40-f46e-44f1-a09d-68f501c60a5a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:42.778519 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7b7e8f40-f46e-44f1-a09d-68f501c60a5a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:42.782303 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7b7e8f40-f46e-44f1-a09d-68f501c60a5a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:42.783599 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7b7e8f40-f46e-44f1-a09d-68f501c60a5a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:42.784588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7b7e8f40-f46e-44f1-a09d-68f501c60a5a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:42.787738 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7b7e8f40-f46e-44f1-a09d-68f501c60a5a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:42.790986 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7b7e8f40-f46e-44f1-a09d-68f501c60a5a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:42.983766 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7b7e8f40-f46e-44f1-a09d-68f501c60a5a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:43.005878 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7b7e8f40-f46e-44f1-a09d-68f501c60a5a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1284 microversion: 2.1 time: 0.246345 Aug 04 22:20:43.021624 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 35/65] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:42 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:43.192821 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4690fb9a-690f-4347-b425-f9237fb24074 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:43.193472 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-531adbb2-f947-4873-8261-0cad660ed818 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:43.194067 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-531adbb2-f947-4873-8261-0cad660ed818 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:43.202011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4690fb9a-690f-4347-b425-f9237fb24074 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:43.203449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-531adbb2-f947-4873-8261-0cad660ed818 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:43.203933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-531adbb2-f947-4873-8261-0cad660ed818 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:43.210733 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-531adbb2-f947-4873-8261-0cad660ed818 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:43.212018 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-531adbb2-f947-4873-8261-0cad660ed818 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:43.213022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-531adbb2-f947-4873-8261-0cad660ed818 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:43.214136 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-531adbb2-f947-4873-8261-0cad660ed818 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:43.217835 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4690fb9a-690f-4347-b425-f9237fb24074 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:43.238509 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4690fb9a-690f-4347-b425-f9237fb24074 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 1.093275 Aug 04 22:20:43.239265 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 31/66] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:42 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:44.030298 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a8bc8c42-7130-47bc-ad01-5e6b59503ebf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:44.032002 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a8bc8c42-7130-47bc-ad01-5e6b59503ebf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:44.043214 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a8bc8c42-7130-47bc-ad01-5e6b59503ebf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:44.044442 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a8bc8c42-7130-47bc-ad01-5e6b59503ebf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:44.047843 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a8bc8c42-7130-47bc-ad01-5e6b59503ebf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:44.049006 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a8bc8c42-7130-47bc-ad01-5e6b59503ebf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:44.049823 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a8bc8c42-7130-47bc-ad01-5e6b59503ebf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:44.050724 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a8bc8c42-7130-47bc-ad01-5e6b59503ebf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:44.292423 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-531adbb2-f947-4873-8261-0cad660ed818 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:44.308081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-531adbb2-f947-4873-8261-0cad660ed818 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 1.119584 Aug 04 22:20:44.317574 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 36/67] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:43 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:44.351756 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e6d51dfe-b016-4036-aeef-e2ad63cf5b2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:44.355891 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e6d51dfe-b016-4036-aeef-e2ad63cf5b2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:44.404222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e6d51dfe-b016-4036-aeef-e2ad63cf5b2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:44.409560 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e6d51dfe-b016-4036-aeef-e2ad63cf5b2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:44.418474 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e6d51dfe-b016-4036-aeef-e2ad63cf5b2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:44.425999 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e6d51dfe-b016-4036-aeef-e2ad63cf5b2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:44.428363 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e6d51dfe-b016-4036-aeef-e2ad63cf5b2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:44.429704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e6d51dfe-b016-4036-aeef-e2ad63cf5b2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:45.048393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e6d51dfe-b016-4036-aeef-e2ad63cf5b2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:45.059411 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e6d51dfe-b016-4036-aeef-e2ad63cf5b2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:45.063679 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e6d51dfe-b016-4036-aeef-e2ad63cf5b2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:45.066408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e6d51dfe-b016-4036-aeef-e2ad63cf5b2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.743169 Aug 04 22:20:45.069616 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 37/68] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:44 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:45.100911 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a8bc8c42-7130-47bc-ad01-5e6b59503ebf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:45.149738 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a8bc8c42-7130-47bc-ad01-5e6b59503ebf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 1.119727 Aug 04 22:20:45.150648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 32/69] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:44 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:45.155063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1080287724", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b91150e-ffb3-48d1-826e-331e5df87d0e"}], "security_groups": [{"name": "tempest-securitygroup--1273975715"}], "key_name": "tempest-keypair-2071018194", "user_data": "}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:45.337911 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bc59990e-2a53-4682-9091-16e33f36056e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:45.338337 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bc59990e-2a53-4682-9091-16e33f36056e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:45.350772 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc59990e-2a53-4682-9091-16e33f36056e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:45.351582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc59990e-2a53-4682-9091-16e33f36056e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:45.351707 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc59990e-2a53-4682-9091-16e33f36056e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:45.352429 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc59990e-2a53-4682-9091-16e33f36056e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:45.352887 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc59990e-2a53-4682-9091-16e33f36056e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:45.353855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc59990e-2a53-4682-9091-16e33f36056e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:45.407407 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.network.neutron [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] validate_networks() for [('7b91150e-ffb3-48d1-826e-331e5df87d0e', None, None, None, None, None)] {{(pid=129196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:20:45.603641 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bc59990e-2a53-4682-9091-16e33f36056e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:45.615762 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bc59990e-2a53-4682-9091-16e33f36056e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.283253 Aug 04 22:20:45.618282 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 33/70] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:45 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:45.629053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-f4577cd4-ee0b-468d-b6e9-851da1a15292 req-dc16d546-e70e-4ad3-810c-f433fb6882bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6318eb70-fdcf-4545-b737-61e032221d53", "tag": "39cb006e-1fc6-41fe-8b9f-b8a5c87f0721"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:45.644062 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-f4577cd4-ee0b-468d-b6e9-851da1a15292 req-dc16d546-e70e-4ad3-810c-f433fb6882bd service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:45.645632 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-f4577cd4-ee0b-468d-b6e9-851da1a15292 req-dc16d546-e70e-4ad3-810c-f433fb6882bd service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:45.646072 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-f4577cd4-ee0b-468d-b6e9-851da1a15292 req-dc16d546-e70e-4ad3-810c-f433fb6882bd service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:45.657215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-f4577cd4-ee0b-468d-b6e9-851da1a15292 req-dc16d546-e70e-4ad3-810c-f433fb6882bd service nova] Creating event network-changed:39cb006e-1fc6-41fe-8b9f-b8a5c87f0721 for instance 6318eb70-fdcf-4545-b737-61e032221d53 on hv-cinder-85221 Aug 04 22:20:45.662812 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-f4577cd4-ee0b-468d-b6e9-851da1a15292 req-dc16d546-e70e-4ad3-810c-f433fb6882bd service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042269 Aug 04 22:20:45.663573 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 34/71] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:46.098532 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2783be0a-d142-43d6-8467-ccf56a5a54e4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:46.113587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2783be0a-d142-43d6-8467-ccf56a5a54e4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:46.121331 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2783be0a-d142-43d6-8467-ccf56a5a54e4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:46.121915 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2783be0a-d142-43d6-8467-ccf56a5a54e4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:46.122414 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2783be0a-d142-43d6-8467-ccf56a5a54e4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:46.123183 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2783be0a-d142-43d6-8467-ccf56a5a54e4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:46.123712 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2783be0a-d142-43d6-8467-ccf56a5a54e4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:46.124198 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2783be0a-d142-43d6-8467-ccf56a5a54e4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:46.274949 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2783be0a-d142-43d6-8467-ccf56a5a54e4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:46.284408 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2783be0a-d142-43d6-8467-ccf56a5a54e4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:46.286681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2783be0a-d142-43d6-8467-ccf56a5a54e4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:46.287226 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2783be0a-d142-43d6-8467-ccf56a5a54e4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.193966 Aug 04 22:20:46.288326 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 35/72] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:46 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:20:46.306340 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-029ba365-45d6-4a6f-8073-d14450889180 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:46.306965 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-029ba365-45d6-4a6f-8073-d14450889180 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:46.314475 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-029ba365-45d6-4a6f-8073-d14450889180 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:46.315013 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-029ba365-45d6-4a6f-8073-d14450889180 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:46.315596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-029ba365-45d6-4a6f-8073-d14450889180 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:46.316307 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-029ba365-45d6-4a6f-8073-d14450889180 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:46.321849 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-029ba365-45d6-4a6f-8073-d14450889180 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:46.322492 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-029ba365-45d6-4a6f-8073-d14450889180 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:46.327111 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Flavor limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:20:46.328335 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Image limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:20:46.328980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Flavor pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:20:46.329606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Image pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:20:46.330184 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:20:46.340285 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:46.340961 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:46.341687 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:46.342551 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:46.343353 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:46.343944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:46.369809 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for project 011b296da6654fa38f76eadd7bebae6f. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:20:46.378184 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for user 8c50160e51b54cde9a3f617d71fbf1c0 and project 011b296da6654fa38f76eadd7bebae6f. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:20:46.390838 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Going to run 1 instances... {{(pid=129196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:20:46.393762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:20:46.450320 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-be37ac25-993c-4319-a17a-cb047651bb8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.299700 Aug 04 22:20:46.451960 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 38/73] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:20:45 2022] POST /compute/v2.1/servers => generated 404 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:20:46.458389 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-a714cde3-830b-43a7-9d6f-8eb807561812 req-d5a8e9cd-8194-4594-80c5-d9f64f3a899a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33083aef-a898-484c-9060-827392ed18bc", "tag": "dce2fd0b-8452-4b56-810e-62ae9cf27a28"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:20:46.471842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a714cde3-830b-43a7-9d6f-8eb807561812 req-d5a8e9cd-8194-4594-80c5-d9f64f3a899a service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:46.472418 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a714cde3-830b-43a7-9d6f-8eb807561812 req-d5a8e9cd-8194-4594-80c5-d9f64f3a899a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:46.472911 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a714cde3-830b-43a7-9d6f-8eb807561812 req-d5a8e9cd-8194-4594-80c5-d9f64f3a899a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:46.509790 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-a714cde3-830b-43a7-9d6f-8eb807561812 req-d5a8e9cd-8194-4594-80c5-d9f64f3a899a service nova] Creating event network-changed:dce2fd0b-8452-4b56-810e-62ae9cf27a28 for instance 33083aef-a898-484c-9060-827392ed18bc on hv-cinder-85221 Aug 04 22:20:46.515876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-a714cde3-830b-43a7-9d6f-8eb807561812 req-d5a8e9cd-8194-4594-80c5-d9f64f3a899a service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062634 Aug 04 22:20:46.516488 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 39/74] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:20:46.527897 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6f758017-626f-4268-a381-329f841072e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:46.528596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6f758017-626f-4268-a381-329f841072e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:46.561755 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-029ba365-45d6-4a6f-8073-d14450889180 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:46.570031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-029ba365-45d6-4a6f-8073-d14450889180 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.280436 Aug 04 22:20:46.572931 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 36/75] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:46 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:46.621454 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6f758017-626f-4268-a381-329f841072e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:46.630011 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6f758017-626f-4268-a381-329f841072e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1246 microversion: 2.1 time: 0.112187 Aug 04 22:20:46.637842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 40/76] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:46 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1246 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:46.639268 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-5fb58c6c-5652-4533-873a-24d95a2a7f90 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:46.639875 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-5fb58c6c-5652-4533-873a-24d95a2a7f90 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:46.646948 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5fb58c6c-5652-4533-873a-24d95a2a7f90 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:46.647808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5fb58c6c-5652-4533-873a-24d95a2a7f90 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:46.648235 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5fb58c6c-5652-4533-873a-24d95a2a7f90 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:46.648934 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5fb58c6c-5652-4533-873a-24d95a2a7f90 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:46.649496 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5fb58c6c-5652-4533-873a-24d95a2a7f90 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:46.649848 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5fb58c6c-5652-4533-873a-24d95a2a7f90 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:46.803607 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-5fb58c6c-5652-4533-873a-24d95a2a7f90 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:46.812820 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-5fb58c6c-5652-4533-873a-24d95a2a7f90 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.177257 Aug 04 22:20:46.813669 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 37/77] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:46 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:47.309822 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b3fb6146-89b3-40a2-aca8-71f4ee8c85bd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:47.310436 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b3fb6146-89b3-40a2-aca8-71f4ee8c85bd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:47.317365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3fb6146-89b3-40a2-aca8-71f4ee8c85bd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:47.317880 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3fb6146-89b3-40a2-aca8-71f4ee8c85bd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:47.318317 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3fb6146-89b3-40a2-aca8-71f4ee8c85bd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:47.319017 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3fb6146-89b3-40a2-aca8-71f4ee8c85bd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:47.319470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3fb6146-89b3-40a2-aca8-71f4ee8c85bd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:47.319892 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3fb6146-89b3-40a2-aca8-71f4ee8c85bd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:47.476717 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b3fb6146-89b3-40a2-aca8-71f4ee8c85bd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:47.488542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b3fb6146-89b3-40a2-aca8-71f4ee8c85bd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:47.491131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b3fb6146-89b3-40a2-aca8-71f4ee8c85bd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:47.508105 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b3fb6146-89b3-40a2-aca8-71f4ee8c85bd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.186551 Aug 04 22:20:47.521674 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 41/78] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:47 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:47.594073 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-5d71aaca-cd5d-46c3-b58e-b3e7df86a7bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:47.595050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-5d71aaca-cd5d-46c3-b58e-b3e7df86a7bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:47.605780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5d71aaca-cd5d-46c3-b58e-b3e7df86a7bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:47.607808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5d71aaca-cd5d-46c3-b58e-b3e7df86a7bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:47.608952 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5d71aaca-cd5d-46c3-b58e-b3e7df86a7bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:47.610315 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5d71aaca-cd5d-46c3-b58e-b3e7df86a7bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:47.612753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5d71aaca-cd5d-46c3-b58e-b3e7df86a7bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:47.613449 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5d71aaca-cd5d-46c3-b58e-b3e7df86a7bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:47.651120 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0f99416d-14d9-44c2-abfb-e430439c0d8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:47.651809 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0f99416d-14d9-44c2-abfb-e430439c0d8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:47.668039 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f99416d-14d9-44c2-abfb-e430439c0d8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:47.670314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f99416d-14d9-44c2-abfb-e430439c0d8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:47.670962 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f99416d-14d9-44c2-abfb-e430439c0d8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:47.672761 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f99416d-14d9-44c2-abfb-e430439c0d8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:47.673937 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f99416d-14d9-44c2-abfb-e430439c0d8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:47.675588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f99416d-14d9-44c2-abfb-e430439c0d8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:47.730697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=30 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:47.836020 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0f99416d-14d9-44c2-abfb-e430439c0d8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:47.844868 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0f99416d-14d9-44c2-abfb-e430439c0d8b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1242 microversion: 2.1 time: 0.197820 Aug 04 22:20:47.847544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 42/79] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:47 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1242 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:47.856596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-466c6471-b6a6-4d98-a587-de19ce125761 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:47.858653 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-466c6471-b6a6-4d98-a587-de19ce125761 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:47.874240 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-466c6471-b6a6-4d98-a587-de19ce125761 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:47.875296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-466c6471-b6a6-4d98-a587-de19ce125761 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:47.875890 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-466c6471-b6a6-4d98-a587-de19ce125761 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:47.876866 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-466c6471-b6a6-4d98-a587-de19ce125761 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:47.877707 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-466c6471-b6a6-4d98-a587-de19ce125761 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:47.878599 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-466c6471-b6a6-4d98-a587-de19ce125761 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:47.999677 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-5d71aaca-cd5d-46c3-b58e-b3e7df86a7bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:48.009689 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-5d71aaca-cd5d-46c3-b58e-b3e7df86a7bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.419819 Aug 04 22:20:48.019940 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 38/80] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:47 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:48.067955 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-466c6471-b6a6-4d98-a587-de19ce125761 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:48.082307 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-466c6471-b6a6-4d98-a587-de19ce125761 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.233343 Aug 04 22:20:48.082899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 43/81] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:47 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:48.533590 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1356d927-649c-46e6-b3c1-faa252bef685 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:48.534366 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1356d927-649c-46e6-b3c1-faa252bef685 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:48.540363 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1356d927-649c-46e6-b3c1-faa252bef685 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:48.540888 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1356d927-649c-46e6-b3c1-faa252bef685 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:48.541324 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1356d927-649c-46e6-b3c1-faa252bef685 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:48.542052 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1356d927-649c-46e6-b3c1-faa252bef685 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:48.542507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1356d927-649c-46e6-b3c1-faa252bef685 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:48.542931 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1356d927-649c-46e6-b3c1-faa252bef685 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:48.672176 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1356d927-649c-46e6-b3c1-faa252bef685 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:48.680598 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1356d927-649c-46e6-b3c1-faa252bef685 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:48.682139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1356d927-649c-46e6-b3c1-faa252bef685 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:48.683234 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1356d927-649c-46e6-b3c1-faa252bef685 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.153656 Aug 04 22:20:48.683809 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 39/82] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:48 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:48.868583 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8e53d088-be32-454d-93b6-ec45801c4a74 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:48.869225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8e53d088-be32-454d-93b6-ec45801c4a74 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:48.871209 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:48.878664 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8e53d088-be32-454d-93b6-ec45801c4a74 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:48.879345 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8e53d088-be32-454d-93b6-ec45801c4a74 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:48.879833 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8e53d088-be32-454d-93b6-ec45801c4a74 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:48.880680 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8e53d088-be32-454d-93b6-ec45801c4a74 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:48.881191 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8e53d088-be32-454d-93b6-ec45801c4a74 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:48.881717 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8e53d088-be32-454d-93b6-ec45801c4a74 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:48.886281 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=97 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:48.942673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8e53d088-be32-454d-93b6-ec45801c4a74 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:48.950050 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8e53d088-be32-454d-93b6-ec45801c4a74 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.085324 Aug 04 22:20:48.950616 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 44/83] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:48 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:49.031815 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-36e90797-ce25-4a33-8abc-ff7219d64c7b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:49.032461 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-36e90797-ce25-4a33-8abc-ff7219d64c7b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:49.039409 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36e90797-ce25-4a33-8abc-ff7219d64c7b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:49.039894 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36e90797-ce25-4a33-8abc-ff7219d64c7b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:49.040328 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36e90797-ce25-4a33-8abc-ff7219d64c7b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:49.041016 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36e90797-ce25-4a33-8abc-ff7219d64c7b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:49.041512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36e90797-ce25-4a33-8abc-ff7219d64c7b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:49.041939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36e90797-ce25-4a33-8abc-ff7219d64c7b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:49.103418 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3e01a43a-f3a2-4d4f-a884-cdad7f9d2a06 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:49.104033 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3e01a43a-f3a2-4d4f-a884-cdad7f9d2a06 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:49.110019 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e01a43a-f3a2-4d4f-a884-cdad7f9d2a06 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:49.110500 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e01a43a-f3a2-4d4f-a884-cdad7f9d2a06 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:49.110933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e01a43a-f3a2-4d4f-a884-cdad7f9d2a06 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:49.113752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e01a43a-f3a2-4d4f-a884-cdad7f9d2a06 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:49.113752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e01a43a-f3a2-4d4f-a884-cdad7f9d2a06 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:49.114103 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e01a43a-f3a2-4d4f-a884-cdad7f9d2a06 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:49.187637 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-36e90797-ce25-4a33-8abc-ff7219d64c7b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:49.190212 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=93 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:49.196888 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-36e90797-ce25-4a33-8abc-ff7219d64c7b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.168869 Aug 04 22:20:49.197839 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 40/84] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:49 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:49.259627 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3e01a43a-f3a2-4d4f-a884-cdad7f9d2a06 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:49.267565 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3e01a43a-f3a2-4d4f-a884-cdad7f9d2a06 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.168065 Aug 04 22:20:49.268132 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 45/85] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:49 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:49.706461 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d4da17b1-d2fe-494f-a803-4888173a5446 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:49.706975 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d4da17b1-d2fe-494f-a803-4888173a5446 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:49.712607 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4da17b1-d2fe-494f-a803-4888173a5446 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:49.713096 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4da17b1-d2fe-494f-a803-4888173a5446 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:49.713567 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4da17b1-d2fe-494f-a803-4888173a5446 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:49.714262 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4da17b1-d2fe-494f-a803-4888173a5446 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:49.714717 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4da17b1-d2fe-494f-a803-4888173a5446 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:49.715143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4da17b1-d2fe-494f-a803-4888173a5446 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:49.843530 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d4da17b1-d2fe-494f-a803-4888173a5446 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:49.851877 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d4da17b1-d2fe-494f-a803-4888173a5446 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:49.853396 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d4da17b1-d2fe-494f-a803-4888173a5446 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:49.854524 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d4da17b1-d2fe-494f-a803-4888173a5446 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.153042 Aug 04 22:20:49.855082 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 41/86] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:49 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:49.970653 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0defa3bb-8050-456d-9f7e-a9d9df204f16 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:49.971366 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0defa3bb-8050-456d-9f7e-a9d9df204f16 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:49.977304 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0defa3bb-8050-456d-9f7e-a9d9df204f16 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:49.977811 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0defa3bb-8050-456d-9f7e-a9d9df204f16 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:49.978240 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0defa3bb-8050-456d-9f7e-a9d9df204f16 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:49.978924 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0defa3bb-8050-456d-9f7e-a9d9df204f16 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:49.979366 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0defa3bb-8050-456d-9f7e-a9d9df204f16 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:49.979784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0defa3bb-8050-456d-9f7e-a9d9df204f16 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:50.040091 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0defa3bb-8050-456d-9f7e-a9d9df204f16 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:50.047417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0defa3bb-8050-456d-9f7e-a9d9df204f16 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.080668 Aug 04 22:20:50.047973 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 46/87] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:49 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:50.218104 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-dd3f6ccc-4cfb-4c1d-a371-db8493597971 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:50.218718 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-dd3f6ccc-4cfb-4c1d-a371-db8493597971 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:50.224769 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dd3f6ccc-4cfb-4c1d-a371-db8493597971 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:50.225202 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dd3f6ccc-4cfb-4c1d-a371-db8493597971 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:50.225678 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dd3f6ccc-4cfb-4c1d-a371-db8493597971 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:50.226371 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dd3f6ccc-4cfb-4c1d-a371-db8493597971 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:50.226830 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dd3f6ccc-4cfb-4c1d-a371-db8493597971 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:50.227259 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dd3f6ccc-4cfb-4c1d-a371-db8493597971 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:50.288127 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c541d464-a2d0-4923-8102-ab19d799e779 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:50.288743 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c541d464-a2d0-4923-8102-ab19d799e779 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:50.294663 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c541d464-a2d0-4923-8102-ab19d799e779 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:50.295153 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c541d464-a2d0-4923-8102-ab19d799e779 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:50.295587 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c541d464-a2d0-4923-8102-ab19d799e779 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:50.296286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c541d464-a2d0-4923-8102-ab19d799e779 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:50.296781 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c541d464-a2d0-4923-8102-ab19d799e779 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:50.297214 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c541d464-a2d0-4923-8102-ab19d799e779 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:50.354284 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-dd3f6ccc-4cfb-4c1d-a371-db8493597971 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:50.363077 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-dd3f6ccc-4cfb-4c1d-a371-db8493597971 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.147594 Aug 04 22:20:50.363846 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 42/88] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:50 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:50.427398 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c541d464-a2d0-4923-8102-ab19d799e779 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:50.434645 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c541d464-a2d0-4923-8102-ab19d799e779 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.150369 Aug 04 22:20:50.435208 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 47/89] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:50 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:50.876899 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b52a5c55-886e-465f-9bd4-9e526483cff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:50.878193 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b52a5c55-886e-465f-9bd4-9e526483cff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:50.884663 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b52a5c55-886e-465f-9bd4-9e526483cff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:50.885153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b52a5c55-886e-465f-9bd4-9e526483cff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:50.885663 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b52a5c55-886e-465f-9bd4-9e526483cff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:50.886475 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b52a5c55-886e-465f-9bd4-9e526483cff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:50.886942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b52a5c55-886e-465f-9bd4-9e526483cff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:50.887370 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b52a5c55-886e-465f-9bd4-9e526483cff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:51.016662 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b52a5c55-886e-465f-9bd4-9e526483cff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:51.025281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b52a5c55-886e-465f-9bd4-9e526483cff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:51.026848 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b52a5c55-886e-465f-9bd4-9e526483cff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:51.027951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b52a5c55-886e-465f-9bd4-9e526483cff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.155745 Aug 04 22:20:51.028505 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 43/90] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:50 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:51.067223 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d6c8e456-aa01-4bce-b630-7c99a8950fc0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:51.067837 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d6c8e456-aa01-4bce-b630-7c99a8950fc0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:51.073766 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6c8e456-aa01-4bce-b630-7c99a8950fc0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:51.074249 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6c8e456-aa01-4bce-b630-7c99a8950fc0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:51.074686 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6c8e456-aa01-4bce-b630-7c99a8950fc0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:51.075385 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6c8e456-aa01-4bce-b630-7c99a8950fc0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:51.075847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6c8e456-aa01-4bce-b630-7c99a8950fc0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:51.076274 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6c8e456-aa01-4bce-b630-7c99a8950fc0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:51.137636 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d6c8e456-aa01-4bce-b630-7c99a8950fc0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:51.145645 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d6c8e456-aa01-4bce-b630-7c99a8950fc0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.082289 Aug 04 22:20:51.146207 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 48/91] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:51 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:51.383676 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2452e8d2-c4f8-4402-9581-4bc049c9f44d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:51.384294 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2452e8d2-c4f8-4402-9581-4bc049c9f44d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:51.390279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2452e8d2-c4f8-4402-9581-4bc049c9f44d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:51.390713 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2452e8d2-c4f8-4402-9581-4bc049c9f44d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:51.391151 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2452e8d2-c4f8-4402-9581-4bc049c9f44d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:51.391847 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2452e8d2-c4f8-4402-9581-4bc049c9f44d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:51.392301 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2452e8d2-c4f8-4402-9581-4bc049c9f44d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:51.392797 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2452e8d2-c4f8-4402-9581-4bc049c9f44d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:51.456182 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5391a503-d6d4-4bdd-846f-a8a66ce664c0 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:51.456956 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5391a503-d6d4-4bdd-846f-a8a66ce664c0 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:51.462937 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5391a503-d6d4-4bdd-846f-a8a66ce664c0 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:51.463487 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5391a503-d6d4-4bdd-846f-a8a66ce664c0 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:51.463981 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5391a503-d6d4-4bdd-846f-a8a66ce664c0 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:51.464735 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5391a503-d6d4-4bdd-846f-a8a66ce664c0 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:51.465247 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5391a503-d6d4-4bdd-846f-a8a66ce664c0 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:51.465755 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5391a503-d6d4-4bdd-846f-a8a66ce664c0 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:51.527202 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2452e8d2-c4f8-4402-9581-4bc049c9f44d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:51.535445 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2452e8d2-c4f8-4402-9581-4bc049c9f44d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.155633 Aug 04 22:20:51.537264 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 44/92] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:51 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:51.610752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5391a503-d6d4-4bdd-846f-a8a66ce664c0 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:51.618304 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5391a503-d6d4-4bdd-846f-a8a66ce664c0 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.166646 Aug 04 22:20:51.618865 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 49/93] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:51 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:52.051548 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3ca75744-14ed-4a5d-9e4d-dc579568ee96 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:52.052076 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3ca75744-14ed-4a5d-9e4d-dc579568ee96 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:52.058884 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3ca75744-14ed-4a5d-9e4d-dc579568ee96 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:52.059378 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3ca75744-14ed-4a5d-9e4d-dc579568ee96 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:52.059818 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3ca75744-14ed-4a5d-9e4d-dc579568ee96 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:52.060514 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3ca75744-14ed-4a5d-9e4d-dc579568ee96 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:52.060970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3ca75744-14ed-4a5d-9e4d-dc579568ee96 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:52.061397 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3ca75744-14ed-4a5d-9e4d-dc579568ee96 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:52.076190 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=4 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:52.176217 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6f39a0c9-f93f-4dfc-a176-7e1b3d568ce0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:52.176835 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6f39a0c9-f93f-4dfc-a176-7e1b3d568ce0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:52.182786 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6f39a0c9-f93f-4dfc-a176-7e1b3d568ce0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:52.183269 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6f39a0c9-f93f-4dfc-a176-7e1b3d568ce0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:52.183703 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6f39a0c9-f93f-4dfc-a176-7e1b3d568ce0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:52.184401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6f39a0c9-f93f-4dfc-a176-7e1b3d568ce0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:52.184858 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6f39a0c9-f93f-4dfc-a176-7e1b3d568ce0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:52.185280 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6f39a0c9-f93f-4dfc-a176-7e1b3d568ce0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:52.197466 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3ca75744-14ed-4a5d-9e4d-dc579568ee96 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:52.206316 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3ca75744-14ed-4a5d-9e4d-dc579568ee96 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:52.207911 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3ca75744-14ed-4a5d-9e4d-dc579568ee96 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:52.209176 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3ca75744-14ed-4a5d-9e4d-dc579568ee96 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.162108 Aug 04 22:20:52.210011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 45/94] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:52 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:52.248283 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6f39a0c9-f93f-4dfc-a176-7e1b3d568ce0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:52.256082 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6f39a0c9-f93f-4dfc-a176-7e1b3d568ce0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.084463 Aug 04 22:20:52.256635 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 50/95] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:52 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:52.556959 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d4449e52-232c-4c0b-99ed-9d80ba0727e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:52.557615 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d4449e52-232c-4c0b-99ed-9d80ba0727e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:52.563449 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4449e52-232c-4c0b-99ed-9d80ba0727e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:52.563933 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4449e52-232c-4c0b-99ed-9d80ba0727e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:52.564365 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4449e52-232c-4c0b-99ed-9d80ba0727e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:52.565197 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4449e52-232c-4c0b-99ed-9d80ba0727e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:52.565684 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4449e52-232c-4c0b-99ed-9d80ba0727e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:52.566140 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4449e52-232c-4c0b-99ed-9d80ba0727e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:52.639464 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-02f4844a-086d-4e3a-9e38-e666cee97d0f tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:52.640282 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-02f4844a-086d-4e3a-9e38-e666cee97d0f tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:52.647471 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02f4844a-086d-4e3a-9e38-e666cee97d0f tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:52.648055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02f4844a-086d-4e3a-9e38-e666cee97d0f tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:52.648547 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02f4844a-086d-4e3a-9e38-e666cee97d0f tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:52.649301 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02f4844a-086d-4e3a-9e38-e666cee97d0f tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:52.649842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02f4844a-086d-4e3a-9e38-e666cee97d0f tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:52.650344 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02f4844a-086d-4e3a-9e38-e666cee97d0f tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:52.703795 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d4449e52-232c-4c0b-99ed-9d80ba0727e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:52.712853 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d4449e52-232c-4c0b-99ed-9d80ba0727e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.159623 Aug 04 22:20:52.717080 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 46/96] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:52 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:52.784498 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-02f4844a-086d-4e3a-9e38-e666cee97d0f tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:52.794483 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-02f4844a-086d-4e3a-9e38-e666cee97d0f tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.158747 Aug 04 22:20:52.795065 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 51/97] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:52 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:53.232348 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e0fbbdef-87da-4bba-8aac-6e7b20b89dab tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:53.232933 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e0fbbdef-87da-4bba-8aac-6e7b20b89dab tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:53.239379 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0fbbdef-87da-4bba-8aac-6e7b20b89dab tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:53.239860 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0fbbdef-87da-4bba-8aac-6e7b20b89dab tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:53.240287 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0fbbdef-87da-4bba-8aac-6e7b20b89dab tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:53.240999 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0fbbdef-87da-4bba-8aac-6e7b20b89dab tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:53.241472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0fbbdef-87da-4bba-8aac-6e7b20b89dab tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:53.241892 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0fbbdef-87da-4bba-8aac-6e7b20b89dab tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:53.276011 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-163faa0f-db8d-4ee8-a051-56910257d906 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:53.276639 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-163faa0f-db8d-4ee8-a051-56910257d906 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:53.283716 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-163faa0f-db8d-4ee8-a051-56910257d906 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:53.284208 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-163faa0f-db8d-4ee8-a051-56910257d906 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:53.284686 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-163faa0f-db8d-4ee8-a051-56910257d906 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:53.285448 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-163faa0f-db8d-4ee8-a051-56910257d906 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:53.285961 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-163faa0f-db8d-4ee8-a051-56910257d906 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:53.288817 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-163faa0f-db8d-4ee8-a051-56910257d906 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:53.364136 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-163faa0f-db8d-4ee8-a051-56910257d906 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:53.372231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-163faa0f-db8d-4ee8-a051-56910257d906 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.099931 Aug 04 22:20:53.385678 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 52/98] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:53 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:53.396328 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e0fbbdef-87da-4bba-8aac-6e7b20b89dab tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:53.404516 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e0fbbdef-87da-4bba-8aac-6e7b20b89dab tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:53.406201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e0fbbdef-87da-4bba-8aac-6e7b20b89dab tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:53.407316 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e0fbbdef-87da-4bba-8aac-6e7b20b89dab tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.178889 Aug 04 22:20:53.408013 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 47/99] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:53 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:53.733979 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6748cf60-b92b-4aba-9c9d-f7b0667c3d3f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:53.734594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6748cf60-b92b-4aba-9c9d-f7b0667c3d3f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:53.740994 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6748cf60-b92b-4aba-9c9d-f7b0667c3d3f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:53.741507 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6748cf60-b92b-4aba-9c9d-f7b0667c3d3f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:53.741942 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6748cf60-b92b-4aba-9c9d-f7b0667c3d3f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:53.742640 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6748cf60-b92b-4aba-9c9d-f7b0667c3d3f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:53.743096 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6748cf60-b92b-4aba-9c9d-f7b0667c3d3f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:53.743522 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6748cf60-b92b-4aba-9c9d-f7b0667c3d3f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:53.817024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a1cc81e6-591d-4b9e-aeb8-bf3ba86dd456 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:53.817669 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a1cc81e6-591d-4b9e-aeb8-bf3ba86dd456 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:53.823576 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a1cc81e6-591d-4b9e-aeb8-bf3ba86dd456 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:53.824059 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a1cc81e6-591d-4b9e-aeb8-bf3ba86dd456 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:53.824493 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a1cc81e6-591d-4b9e-aeb8-bf3ba86dd456 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:53.825186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a1cc81e6-591d-4b9e-aeb8-bf3ba86dd456 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:53.825667 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a1cc81e6-591d-4b9e-aeb8-bf3ba86dd456 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:53.826089 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a1cc81e6-591d-4b9e-aeb8-bf3ba86dd456 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:53.870615 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6748cf60-b92b-4aba-9c9d-f7b0667c3d3f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:53.879639 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6748cf60-b92b-4aba-9c9d-f7b0667c3d3f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.149391 Aug 04 22:20:53.880252 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 53/100] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:53 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:53.961854 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a1cc81e6-591d-4b9e-aeb8-bf3ba86dd456 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:53.969229 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a1cc81e6-591d-4b9e-aeb8-bf3ba86dd456 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.157480 Aug 04 22:20:53.969838 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 48/101] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:53 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:54.394417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-bb8513ad-91c3-4275-bde4-5ebcade2b5c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:54.395029 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-bb8513ad-91c3-4275-bde4-5ebcade2b5c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:54.401019 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bb8513ad-91c3-4275-bde4-5ebcade2b5c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:54.401537 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bb8513ad-91c3-4275-bde4-5ebcade2b5c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:54.401974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bb8513ad-91c3-4275-bde4-5ebcade2b5c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:54.402666 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bb8513ad-91c3-4275-bde4-5ebcade2b5c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:54.403121 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bb8513ad-91c3-4275-bde4-5ebcade2b5c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:54.403546 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bb8513ad-91c3-4275-bde4-5ebcade2b5c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:54.430493 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-8fb71169-a606-4580-8bbf-7a229eb7df0d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:54.431035 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-8fb71169-a606-4580-8bbf-7a229eb7df0d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:54.436931 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8fb71169-a606-4580-8bbf-7a229eb7df0d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:54.437678 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8fb71169-a606-4580-8bbf-7a229eb7df0d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:54.437849 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8fb71169-a606-4580-8bbf-7a229eb7df0d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:54.438530 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8fb71169-a606-4580-8bbf-7a229eb7df0d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:54.438979 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8fb71169-a606-4580-8bbf-7a229eb7df0d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:54.439393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8fb71169-a606-4580-8bbf-7a229eb7df0d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:54.465645 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-bb8513ad-91c3-4275-bde4-5ebcade2b5c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:54.474643 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-bb8513ad-91c3-4275-bde4-5ebcade2b5c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.083941 Aug 04 22:20:54.475399 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 54/102] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:54 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:54.574028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8fb71169-a606-4580-8bbf-7a229eb7df0d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:54.582357 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8fb71169-a606-4580-8bbf-7a229eb7df0d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:54.583853 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8fb71169-a606-4580-8bbf-7a229eb7df0d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:54.584936 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-8fb71169-a606-4580-8bbf-7a229eb7df0d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.158340 Aug 04 22:20:54.585517 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 49/103] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:54 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:20:54.901613 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-173ece19-4c10-43cc-a847-21f43b2d9bc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:54.902219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-173ece19-4c10-43cc-a847-21f43b2d9bc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:54.908094 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-173ece19-4c10-43cc-a847-21f43b2d9bc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:54.908567 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-173ece19-4c10-43cc-a847-21f43b2d9bc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:54.908993 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-173ece19-4c10-43cc-a847-21f43b2d9bc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:54.910304 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-173ece19-4c10-43cc-a847-21f43b2d9bc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:54.910916 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-173ece19-4c10-43cc-a847-21f43b2d9bc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:54.911173 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-173ece19-4c10-43cc-a847-21f43b2d9bc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:54.989641 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e2b86f2f-3cc9-4f28-b6c5-06aa4926b469 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:54.990259 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e2b86f2f-3cc9-4f28-b6c5-06aa4926b469 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:54.996327 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e2b86f2f-3cc9-4f28-b6c5-06aa4926b469 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:54.996814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e2b86f2f-3cc9-4f28-b6c5-06aa4926b469 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:54.997247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e2b86f2f-3cc9-4f28-b6c5-06aa4926b469 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:54.997965 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e2b86f2f-3cc9-4f28-b6c5-06aa4926b469 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:54.998421 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e2b86f2f-3cc9-4f28-b6c5-06aa4926b469 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:54.998844 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e2b86f2f-3cc9-4f28-b6c5-06aa4926b469 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:55.039820 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-173ece19-4c10-43cc-a847-21f43b2d9bc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:55.047357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-173ece19-4c10-43cc-a847-21f43b2d9bc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.149637 Aug 04 22:20:55.047931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 55/104] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:54 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:55.127733 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e2b86f2f-3cc9-4f28-b6c5-06aa4926b469 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:55.136089 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e2b86f2f-3cc9-4f28-b6c5-06aa4926b469 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.150775 Aug 04 22:20:55.136663 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 50/105] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:54 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:55.495299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7c9de2bf-38f1-4fd7-a5bc-5dd68fc9ed72 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:55.496155 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7c9de2bf-38f1-4fd7-a5bc-5dd68fc9ed72 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:55.502080 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7c9de2bf-38f1-4fd7-a5bc-5dd68fc9ed72 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:55.502558 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7c9de2bf-38f1-4fd7-a5bc-5dd68fc9ed72 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:55.502988 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7c9de2bf-38f1-4fd7-a5bc-5dd68fc9ed72 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:55.504287 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7c9de2bf-38f1-4fd7-a5bc-5dd68fc9ed72 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:55.505847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7c9de2bf-38f1-4fd7-a5bc-5dd68fc9ed72 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:55.505847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7c9de2bf-38f1-4fd7-a5bc-5dd68fc9ed72 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:55.564633 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7c9de2bf-38f1-4fd7-a5bc-5dd68fc9ed72 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:55.572686 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7c9de2bf-38f1-4fd7-a5bc-5dd68fc9ed72 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.081242 Aug 04 22:20:55.573250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 56/106] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:55 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:55.606803 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-383bda91-a248-4313-a6b5-42542526be71 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:55.607422 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-383bda91-a248-4313-a6b5-42542526be71 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:55.614022 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-383bda91-a248-4313-a6b5-42542526be71 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:55.614507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-383bda91-a248-4313-a6b5-42542526be71 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:55.614945 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-383bda91-a248-4313-a6b5-42542526be71 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:55.615635 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-383bda91-a248-4313-a6b5-42542526be71 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:55.616094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-383bda91-a248-4313-a6b5-42542526be71 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:55.616519 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-383bda91-a248-4313-a6b5-42542526be71 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:55.745066 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-383bda91-a248-4313-a6b5-42542526be71 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:55.753498 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-383bda91-a248-4313-a6b5-42542526be71 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:55.755011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-383bda91-a248-4313-a6b5-42542526be71 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:55.756099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-383bda91-a248-4313-a6b5-42542526be71 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.153126 Aug 04 22:20:55.756638 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 51/107] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:55 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:20:56.067800 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5be0092e-85bd-48d5-b641-761dc27fbf26 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:56.068339 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5be0092e-85bd-48d5-b641-761dc27fbf26 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:56.074419 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5be0092e-85bd-48d5-b641-761dc27fbf26 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:56.074903 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5be0092e-85bd-48d5-b641-761dc27fbf26 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:56.075342 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5be0092e-85bd-48d5-b641-761dc27fbf26 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:56.076036 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5be0092e-85bd-48d5-b641-761dc27fbf26 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:56.076492 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5be0092e-85bd-48d5-b641-761dc27fbf26 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:56.076916 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5be0092e-85bd-48d5-b641-761dc27fbf26 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:56.157265 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-682bdcfc-3df6-42c0-bcf9-a5751692acf2 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:56.157999 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-682bdcfc-3df6-42c0-bcf9-a5751692acf2 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:56.164894 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-682bdcfc-3df6-42c0-bcf9-a5751692acf2 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:56.165492 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-682bdcfc-3df6-42c0-bcf9-a5751692acf2 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:56.165997 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-682bdcfc-3df6-42c0-bcf9-a5751692acf2 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:56.166698 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-682bdcfc-3df6-42c0-bcf9-a5751692acf2 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:56.167149 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-682bdcfc-3df6-42c0-bcf9-a5751692acf2 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:56.167606 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-682bdcfc-3df6-42c0-bcf9-a5751692acf2 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:56.207727 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5be0092e-85bd-48d5-b641-761dc27fbf26 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:56.215115 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5be0092e-85bd-48d5-b641-761dc27fbf26 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.151309 Aug 04 22:20:56.215886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 57/108] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:56 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:56.295583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-682bdcfc-3df6-42c0-bcf9-a5751692acf2 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:56.303135 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-682bdcfc-3df6-42c0-bcf9-a5751692acf2 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.149743 Aug 04 22:20:56.303705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 52/109] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:56 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:56.594364 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-55793b56-27d4-4d74-b999-607533bfb34d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:56.595109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-55793b56-27d4-4d74-b999-607533bfb34d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:56.597616 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=8 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:56.603919 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55793b56-27d4-4d74-b999-607533bfb34d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:56.604468 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55793b56-27d4-4d74-b999-607533bfb34d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:56.604967 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55793b56-27d4-4d74-b999-607533bfb34d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:56.605848 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55793b56-27d4-4d74-b999-607533bfb34d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:56.606368 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55793b56-27d4-4d74-b999-607533bfb34d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:56.606887 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55793b56-27d4-4d74-b999-607533bfb34d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:56.631559 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=22 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:56.674553 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-55793b56-27d4-4d74-b999-607533bfb34d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:56.682899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-55793b56-27d4-4d74-b999-607533bfb34d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.093108 Aug 04 22:20:56.683470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 58/110] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:56 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:56.778352 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b231b82c-60f1-47c9-8bf7-f815bfa06300 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:56.778957 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b231b82c-60f1-47c9-8bf7-f815bfa06300 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:56.785354 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b231b82c-60f1-47c9-8bf7-f815bfa06300 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:56.785862 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b231b82c-60f1-47c9-8bf7-f815bfa06300 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:56.786285 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b231b82c-60f1-47c9-8bf7-f815bfa06300 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:56.786974 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b231b82c-60f1-47c9-8bf7-f815bfa06300 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:56.787422 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b231b82c-60f1-47c9-8bf7-f815bfa06300 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:56.787835 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b231b82c-60f1-47c9-8bf7-f815bfa06300 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:56.921857 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b231b82c-60f1-47c9-8bf7-f815bfa06300 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:56.930363 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b231b82c-60f1-47c9-8bf7-f815bfa06300 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:56.931845 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b231b82c-60f1-47c9-8bf7-f815bfa06300 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:56.932932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b231b82c-60f1-47c9-8bf7-f815bfa06300 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.158464 Aug 04 22:20:56.933511 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 53/111] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:56 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:57.236339 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-28ce9500-1ec9-4010-bc8d-14bf49c65ea7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:57.236871 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-28ce9500-1ec9-4010-bc8d-14bf49c65ea7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:57.244010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-28ce9500-1ec9-4010-bc8d-14bf49c65ea7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:57.244490 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-28ce9500-1ec9-4010-bc8d-14bf49c65ea7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:57.244925 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-28ce9500-1ec9-4010-bc8d-14bf49c65ea7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:57.245654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-28ce9500-1ec9-4010-bc8d-14bf49c65ea7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:57.246112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-28ce9500-1ec9-4010-bc8d-14bf49c65ea7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:57.246541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-28ce9500-1ec9-4010-bc8d-14bf49c65ea7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:57.323388 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6f1afeb2-2732-4af7-8d87-0f2f0ee44029 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:57.324024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6f1afeb2-2732-4af7-8d87-0f2f0ee44029 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:57.329897 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f1afeb2-2732-4af7-8d87-0f2f0ee44029 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:57.330380 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f1afeb2-2732-4af7-8d87-0f2f0ee44029 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:57.330809 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f1afeb2-2732-4af7-8d87-0f2f0ee44029 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:57.331496 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f1afeb2-2732-4af7-8d87-0f2f0ee44029 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:57.331937 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f1afeb2-2732-4af7-8d87-0f2f0ee44029 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:57.332351 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f1afeb2-2732-4af7-8d87-0f2f0ee44029 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:57.378181 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-28ce9500-1ec9-4010-bc8d-14bf49c65ea7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:57.387662 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-28ce9500-1ec9-4010-bc8d-14bf49c65ea7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.155192 Aug 04 22:20:57.388429 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 59/112] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:57 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:57.466662 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6f1afeb2-2732-4af7-8d87-0f2f0ee44029 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:57.474985 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6f1afeb2-2732-4af7-8d87-0f2f0ee44029 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.155389 Aug 04 22:20:57.475563 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 54/113] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:57 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:57.704764 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-381dd0f5-b182-4c2d-a6f9-5994ba79db15 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:57.705422 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-381dd0f5-b182-4c2d-a6f9-5994ba79db15 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:57.712476 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-381dd0f5-b182-4c2d-a6f9-5994ba79db15 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:57.712958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-381dd0f5-b182-4c2d-a6f9-5994ba79db15 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:57.713400 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-381dd0f5-b182-4c2d-a6f9-5994ba79db15 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:57.714107 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-381dd0f5-b182-4c2d-a6f9-5994ba79db15 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:57.714559 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-381dd0f5-b182-4c2d-a6f9-5994ba79db15 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:57.714980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-381dd0f5-b182-4c2d-a6f9-5994ba79db15 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:57.776173 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-381dd0f5-b182-4c2d-a6f9-5994ba79db15 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:57.778374 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:57.785359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-381dd0f5-b182-4c2d-a6f9-5994ba79db15 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.083841 Aug 04 22:20:57.786146 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 60/114] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:57 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:57.956059 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d09503bc-52b8-4e73-a07a-5ce19542b929 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:57.957509 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d09503bc-52b8-4e73-a07a-5ce19542b929 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:57.963530 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d09503bc-52b8-4e73-a07a-5ce19542b929 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:57.964020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d09503bc-52b8-4e73-a07a-5ce19542b929 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:57.964460 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d09503bc-52b8-4e73-a07a-5ce19542b929 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:57.965156 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d09503bc-52b8-4e73-a07a-5ce19542b929 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:57.965664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d09503bc-52b8-4e73-a07a-5ce19542b929 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:57.966077 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d09503bc-52b8-4e73-a07a-5ce19542b929 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:58.098222 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d09503bc-52b8-4e73-a07a-5ce19542b929 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:58.106194 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d09503bc-52b8-4e73-a07a-5ce19542b929 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:58.107706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d09503bc-52b8-4e73-a07a-5ce19542b929 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:58.108820 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d09503bc-52b8-4e73-a07a-5ce19542b929 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.156621 Aug 04 22:20:58.109375 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 55/115] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:57 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:58.408357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-df93eaee-2e72-4526-97d3-0e9026db623c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:58.408971 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-df93eaee-2e72-4526-97d3-0e9026db623c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:58.416813 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-df93eaee-2e72-4526-97d3-0e9026db623c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:58.417321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-df93eaee-2e72-4526-97d3-0e9026db623c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:58.417975 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-df93eaee-2e72-4526-97d3-0e9026db623c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:58.418778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-df93eaee-2e72-4526-97d3-0e9026db623c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:58.419243 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-df93eaee-2e72-4526-97d3-0e9026db623c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:58.420150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-df93eaee-2e72-4526-97d3-0e9026db623c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:58.496386 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3f87e973-29d1-426e-baa7-88d84919fa7d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:58.497004 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3f87e973-29d1-426e-baa7-88d84919fa7d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:58.503850 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3f87e973-29d1-426e-baa7-88d84919fa7d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:58.504564 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3f87e973-29d1-426e-baa7-88d84919fa7d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:58.505152 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3f87e973-29d1-426e-baa7-88d84919fa7d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:58.506060 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3f87e973-29d1-426e-baa7-88d84919fa7d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:58.506660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3f87e973-29d1-426e-baa7-88d84919fa7d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:58.507230 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3f87e973-29d1-426e-baa7-88d84919fa7d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:58.556838 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-df93eaee-2e72-4526-97d3-0e9026db623c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:58.564237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-df93eaee-2e72-4526-97d3-0e9026db623c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.160018 Aug 04 22:20:58.564809 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 61/116] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:58 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:58.642188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3f87e973-29d1-426e-baa7-88d84919fa7d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:58.649705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3f87e973-29d1-426e-baa7-88d84919fa7d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.157185 Aug 04 22:20:58.650276 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 56/117] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:58 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:58.806945 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-fbc4118d-451a-4907-81f9-f71ba974b862 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:58.807558 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-fbc4118d-451a-4907-81f9-f71ba974b862 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:58.813565 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fbc4118d-451a-4907-81f9-f71ba974b862 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:58.814047 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fbc4118d-451a-4907-81f9-f71ba974b862 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:58.814482 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fbc4118d-451a-4907-81f9-f71ba974b862 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:58.815168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fbc4118d-451a-4907-81f9-f71ba974b862 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:58.815622 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fbc4118d-451a-4907-81f9-f71ba974b862 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:58.816570 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fbc4118d-451a-4907-81f9-f71ba974b862 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:58.877664 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-fbc4118d-451a-4907-81f9-f71ba974b862 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:58.885679 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-fbc4118d-451a-4907-81f9-f71ba974b862 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.082601 Aug 04 22:20:58.886240 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 62/118] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:58 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:59.131781 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-432d8281-d944-4de1-bf9c-5ee421427e9b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:59.132413 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-432d8281-d944-4de1-bf9c-5ee421427e9b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:59.138396 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-432d8281-d944-4de1-bf9c-5ee421427e9b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:59.138876 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-432d8281-d944-4de1-bf9c-5ee421427e9b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:59.139337 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-432d8281-d944-4de1-bf9c-5ee421427e9b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:59.140017 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-432d8281-d944-4de1-bf9c-5ee421427e9b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:59.140469 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-432d8281-d944-4de1-bf9c-5ee421427e9b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:59.140891 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-432d8281-d944-4de1-bf9c-5ee421427e9b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:59.156384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=100 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:59.270418 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-432d8281-d944-4de1-bf9c-5ee421427e9b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:59.278632 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-432d8281-d944-4de1-bf9c-5ee421427e9b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:59.280163 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-432d8281-d944-4de1-bf9c-5ee421427e9b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:59.281267 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-432d8281-d944-4de1-bf9c-5ee421427e9b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.153973 Aug 04 22:20:59.281868 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 57/119] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:20:59 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:20:59.585531 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d9d7f377-37f8-4db7-a6ab-d4e16524f1fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:59.586253 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d9d7f377-37f8-4db7-a6ab-d4e16524f1fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:59.592530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d9d7f377-37f8-4db7-a6ab-d4e16524f1fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:59.593015 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d9d7f377-37f8-4db7-a6ab-d4e16524f1fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:59.593477 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d9d7f377-37f8-4db7-a6ab-d4e16524f1fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:59.594168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d9d7f377-37f8-4db7-a6ab-d4e16524f1fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:59.594622 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d9d7f377-37f8-4db7-a6ab-d4e16524f1fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:59.595042 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d9d7f377-37f8-4db7-a6ab-d4e16524f1fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:59.669925 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3b27dcaa-d26e-4970-9700-3f0e3f200a98 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:59.670548 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3b27dcaa-d26e-4970-9700-3f0e3f200a98 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:59.676641 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3b27dcaa-d26e-4970-9700-3f0e3f200a98 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:59.677133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3b27dcaa-d26e-4970-9700-3f0e3f200a98 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:59.677657 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3b27dcaa-d26e-4970-9700-3f0e3f200a98 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:59.678412 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3b27dcaa-d26e-4970-9700-3f0e3f200a98 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:59.678938 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3b27dcaa-d26e-4970-9700-3f0e3f200a98 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:59.679374 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3b27dcaa-d26e-4970-9700-3f0e3f200a98 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:59.728478 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d9d7f377-37f8-4db7-a6ab-d4e16524f1fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:59.735857 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d9d7f377-37f8-4db7-a6ab-d4e16524f1fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.154672 Aug 04 22:20:59.736426 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 63/120] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:59 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:20:59.814727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3b27dcaa-d26e-4970-9700-3f0e3f200a98 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:59.822830 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3b27dcaa-d26e-4970-9700-3f0e3f200a98 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.156815 Aug 04 22:20:59.823388 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 58/121] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:59 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:20:59.905711 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-fe44680a-5d18-459b-a1b4-90d4f184d19b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:20:59.906359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-fe44680a-5d18-459b-a1b4-90d4f184d19b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:20:59.912449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe44680a-5d18-459b-a1b4-90d4f184d19b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:59.912934 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe44680a-5d18-459b-a1b4-90d4f184d19b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:59.913388 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe44680a-5d18-459b-a1b4-90d4f184d19b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:59.914164 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe44680a-5d18-459b-a1b4-90d4f184d19b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:20:59.914623 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe44680a-5d18-459b-a1b4-90d4f184d19b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:20:59.915046 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe44680a-5d18-459b-a1b4-90d4f184d19b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:20:59.976558 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-fe44680a-5d18-459b-a1b4-90d4f184d19b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:20:59.984011 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-fe44680a-5d18-459b-a1b4-90d4f184d19b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.082160 Aug 04 22:20:59.984595 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 64/122] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:20:59 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:00.304770 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0eb9d9aa-a7d6-461e-93d5-196939bb229e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:00.305300 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0eb9d9aa-a7d6-461e-93d5-196939bb229e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:00.311226 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0eb9d9aa-a7d6-461e-93d5-196939bb229e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:00.311706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0eb9d9aa-a7d6-461e-93d5-196939bb229e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:00.312135 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0eb9d9aa-a7d6-461e-93d5-196939bb229e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:00.312809 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0eb9d9aa-a7d6-461e-93d5-196939bb229e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:00.313256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0eb9d9aa-a7d6-461e-93d5-196939bb229e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:00.313724 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0eb9d9aa-a7d6-461e-93d5-196939bb229e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:00.440386 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0eb9d9aa-a7d6-461e-93d5-196939bb229e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:00.448394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0eb9d9aa-a7d6-461e-93d5-196939bb229e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:00.449928 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0eb9d9aa-a7d6-461e-93d5-196939bb229e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:00.451030 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0eb9d9aa-a7d6-461e-93d5-196939bb229e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.150836 Aug 04 22:21:00.451590 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 59/123] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:00 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:00.756604 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-48ed290c-3c62-45c7-abcc-d428cfc6374d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:00.757219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-48ed290c-3c62-45c7-abcc-d428cfc6374d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:00.763178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-48ed290c-3c62-45c7-abcc-d428cfc6374d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:00.763665 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-48ed290c-3c62-45c7-abcc-d428cfc6374d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:00.764101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-48ed290c-3c62-45c7-abcc-d428cfc6374d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:00.764789 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-48ed290c-3c62-45c7-abcc-d428cfc6374d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:00.765244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-48ed290c-3c62-45c7-abcc-d428cfc6374d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:00.765705 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-48ed290c-3c62-45c7-abcc-d428cfc6374d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:00.843780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ad110418-d096-4d19-aff3-0a6a0645e493 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:00.844449 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ad110418-d096-4d19-aff3-0a6a0645e493 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:00.852469 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ad110418-d096-4d19-aff3-0a6a0645e493 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:00.853713 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ad110418-d096-4d19-aff3-0a6a0645e493 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:00.854160 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ad110418-d096-4d19-aff3-0a6a0645e493 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:00.855808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ad110418-d096-4d19-aff3-0a6a0645e493 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:00.857026 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ad110418-d096-4d19-aff3-0a6a0645e493 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:00.857488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ad110418-d096-4d19-aff3-0a6a0645e493 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:00.904306 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-48ed290c-3c62-45c7-abcc-d428cfc6374d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:00.912511 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-48ed290c-3c62-45c7-abcc-d428cfc6374d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.160325 Aug 04 22:21:00.925475 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 65/124] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:00 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:00.993555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ad110418-d096-4d19-aff3-0a6a0645e493 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:01.001323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ad110418-d096-4d19-aff3-0a6a0645e493 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.161583 Aug 04 22:21:01.003758 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 60/125] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:00 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:01.006077 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-68dd1bde-ae21-4bfc-9484-835e801b6392 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:01.006715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-68dd1bde-ae21-4bfc-9484-835e801b6392 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:01.012499 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68dd1bde-ae21-4bfc-9484-835e801b6392 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:01.013136 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68dd1bde-ae21-4bfc-9484-835e801b6392 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:01.013591 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68dd1bde-ae21-4bfc-9484-835e801b6392 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:01.014415 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68dd1bde-ae21-4bfc-9484-835e801b6392 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:01.014871 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68dd1bde-ae21-4bfc-9484-835e801b6392 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:01.015461 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68dd1bde-ae21-4bfc-9484-835e801b6392 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:01.080260 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-68dd1bde-ae21-4bfc-9484-835e801b6392 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:01.087807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-68dd1bde-ae21-4bfc-9484-835e801b6392 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.086228 Aug 04 22:21:01.088374 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 66/126] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:01 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:01.473815 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b2e3d7a8-5e96-42cc-8ace-4dc7aaa22348 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:01.474350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b2e3d7a8-5e96-42cc-8ace-4dc7aaa22348 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:01.480253 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b2e3d7a8-5e96-42cc-8ace-4dc7aaa22348 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:01.480732 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b2e3d7a8-5e96-42cc-8ace-4dc7aaa22348 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:01.481160 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b2e3d7a8-5e96-42cc-8ace-4dc7aaa22348 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:01.481879 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b2e3d7a8-5e96-42cc-8ace-4dc7aaa22348 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:01.482326 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b2e3d7a8-5e96-42cc-8ace-4dc7aaa22348 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:01.482745 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b2e3d7a8-5e96-42cc-8ace-4dc7aaa22348 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:01.611418 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b2e3d7a8-5e96-42cc-8ace-4dc7aaa22348 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:01.619980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b2e3d7a8-5e96-42cc-8ace-4dc7aaa22348 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:01.621524 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b2e3d7a8-5e96-42cc-8ace-4dc7aaa22348 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:01.622626 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b2e3d7a8-5e96-42cc-8ace-4dc7aaa22348 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.153242 Aug 04 22:21:01.623195 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 61/127] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:01 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:01.932145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5b9ab1ea-1660-44e6-8a5b-459d1f886dd8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:01.932764 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5b9ab1ea-1660-44e6-8a5b-459d1f886dd8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:01.938725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b9ab1ea-1660-44e6-8a5b-459d1f886dd8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:01.939212 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b9ab1ea-1660-44e6-8a5b-459d1f886dd8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:01.939643 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b9ab1ea-1660-44e6-8a5b-459d1f886dd8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:01.940340 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b9ab1ea-1660-44e6-8a5b-459d1f886dd8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:01.940865 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b9ab1ea-1660-44e6-8a5b-459d1f886dd8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:01.941296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b9ab1ea-1660-44e6-8a5b-459d1f886dd8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:02.023314 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f15cd180-ec55-493f-a591-84fc1e407cc9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:02.023985 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f15cd180-ec55-493f-a591-84fc1e407cc9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:02.029879 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f15cd180-ec55-493f-a591-84fc1e407cc9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:02.030366 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f15cd180-ec55-493f-a591-84fc1e407cc9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:02.030801 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f15cd180-ec55-493f-a591-84fc1e407cc9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:02.031505 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f15cd180-ec55-493f-a591-84fc1e407cc9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:02.031956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f15cd180-ec55-493f-a591-84fc1e407cc9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:02.032378 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f15cd180-ec55-493f-a591-84fc1e407cc9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:02.093997 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5b9ab1ea-1660-44e6-8a5b-459d1f886dd8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:02.104125 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5b9ab1ea-1660-44e6-8a5b-459d1f886dd8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.175567 Aug 04 22:21:02.105254 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 67/128] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:01 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:02.110371 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9a250381-98ee-4f8b-bccb-d1d9b2fe546b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:02.111202 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9a250381-98ee-4f8b-bccb-d1d9b2fe546b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:02.118088 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9a250381-98ee-4f8b-bccb-d1d9b2fe546b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:02.119076 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9a250381-98ee-4f8b-bccb-d1d9b2fe546b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:02.134572 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9a250381-98ee-4f8b-bccb-d1d9b2fe546b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:02.135944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9a250381-98ee-4f8b-bccb-d1d9b2fe546b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:02.136643 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9a250381-98ee-4f8b-bccb-d1d9b2fe546b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:02.137253 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9a250381-98ee-4f8b-bccb-d1d9b2fe546b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:02.209207 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9a250381-98ee-4f8b-bccb-d1d9b2fe546b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:02.219921 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9a250381-98ee-4f8b-bccb-d1d9b2fe546b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.113201 Aug 04 22:21:02.221280 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 68/129] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:02 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:02.241463 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f15cd180-ec55-493f-a591-84fc1e407cc9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:02.245873 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f15cd180-ec55-493f-a591-84fc1e407cc9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.227397 Aug 04 22:21:02.249506 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 62/130] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:02 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:02.646494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7d4b7703-454f-4672-8c9d-00c52cf91a66 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:02.647137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7d4b7703-454f-4672-8c9d-00c52cf91a66 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:02.653174 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d4b7703-454f-4672-8c9d-00c52cf91a66 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:02.653708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d4b7703-454f-4672-8c9d-00c52cf91a66 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:02.654145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d4b7703-454f-4672-8c9d-00c52cf91a66 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:02.654828 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d4b7703-454f-4672-8c9d-00c52cf91a66 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:02.655280 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d4b7703-454f-4672-8c9d-00c52cf91a66 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:02.655702 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d4b7703-454f-4672-8c9d-00c52cf91a66 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:02.786603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7d4b7703-454f-4672-8c9d-00c52cf91a66 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:02.795186 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7d4b7703-454f-4672-8c9d-00c52cf91a66 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:02.796736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7d4b7703-454f-4672-8c9d-00c52cf91a66 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:02.797877 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7d4b7703-454f-4672-8c9d-00c52cf91a66 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.156155 Aug 04 22:21:02.798440 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 69/131] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:02 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:03.130734 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1e3b1fb1-ff03-4ca5-bab1-632eb61f400f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:03.131346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1e3b1fb1-ff03-4ca5-bab1-632eb61f400f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:03.137445 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1e3b1fb1-ff03-4ca5-bab1-632eb61f400f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:03.137942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1e3b1fb1-ff03-4ca5-bab1-632eb61f400f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:03.138378 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1e3b1fb1-ff03-4ca5-bab1-632eb61f400f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:03.139070 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1e3b1fb1-ff03-4ca5-bab1-632eb61f400f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:03.139524 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1e3b1fb1-ff03-4ca5-bab1-632eb61f400f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:03.139949 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1e3b1fb1-ff03-4ca5-bab1-632eb61f400f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:03.243279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d4b0bc37-ba41-4a73-8ab4-b18efa639fa9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:03.244392 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d4b0bc37-ba41-4a73-8ab4-b18efa639fa9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:03.250556 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4b0bc37-ba41-4a73-8ab4-b18efa639fa9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:03.251074 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4b0bc37-ba41-4a73-8ab4-b18efa639fa9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:03.251511 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4b0bc37-ba41-4a73-8ab4-b18efa639fa9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:03.252211 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4b0bc37-ba41-4a73-8ab4-b18efa639fa9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:03.252663 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4b0bc37-ba41-4a73-8ab4-b18efa639fa9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:03.253148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4b0bc37-ba41-4a73-8ab4-b18efa639fa9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:03.278147 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1e3b1fb1-ff03-4ca5-bab1-632eb61f400f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:03.287029 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1e3b1fb1-ff03-4ca5-bab1-632eb61f400f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.160778 Aug 04 22:21:03.287968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 63/132] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:03 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:03.292666 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-230555ca-e943-4210-b5f9-299cdb26165b tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:03.293275 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-230555ca-e943-4210-b5f9-299cdb26165b tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:03.299900 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-230555ca-e943-4210-b5f9-299cdb26165b tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:03.301089 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-230555ca-e943-4210-b5f9-299cdb26165b tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:03.301976 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-230555ca-e943-4210-b5f9-299cdb26165b tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:03.302702 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-230555ca-e943-4210-b5f9-299cdb26165b tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:03.303147 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-230555ca-e943-4210-b5f9-299cdb26165b tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:03.303825 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-230555ca-e943-4210-b5f9-299cdb26165b tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:03.337382 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d4b0bc37-ba41-4a73-8ab4-b18efa639fa9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:03.346178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d4b0bc37-ba41-4a73-8ab4-b18efa639fa9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.106686 Aug 04 22:21:03.348427 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 70/133] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:03 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:03.447740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-230555ca-e943-4210-b5f9-299cdb26165b tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:03.457330 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-230555ca-e943-4210-b5f9-299cdb26165b tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.167972 Aug 04 22:21:03.457953 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 64/134] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:03 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:03.820825 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-92c28f69-7082-46d7-a554-de575e577e37 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:03.821340 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-92c28f69-7082-46d7-a554-de575e577e37 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:03.827394 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-92c28f69-7082-46d7-a554-de575e577e37 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:03.827869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-92c28f69-7082-46d7-a554-de575e577e37 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:03.828295 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-92c28f69-7082-46d7-a554-de575e577e37 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:03.828967 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-92c28f69-7082-46d7-a554-de575e577e37 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:03.829427 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-92c28f69-7082-46d7-a554-de575e577e37 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:03.829848 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-92c28f69-7082-46d7-a554-de575e577e37 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:03.961850 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-92c28f69-7082-46d7-a554-de575e577e37 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:03.969679 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-92c28f69-7082-46d7-a554-de575e577e37 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:03.971186 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-92c28f69-7082-46d7-a554-de575e577e37 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:03.973064 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-92c28f69-7082-46d7-a554-de575e577e37 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.156116 Aug 04 22:21:03.973655 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 71/135] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:03 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:04.308553 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-19871705-47e6-4fee-a0ee-6d3e095c315b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:04.309176 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-19871705-47e6-4fee-a0ee-6d3e095c315b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:04.315871 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-19871705-47e6-4fee-a0ee-6d3e095c315b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:04.316460 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-19871705-47e6-4fee-a0ee-6d3e095c315b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:04.316908 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-19871705-47e6-4fee-a0ee-6d3e095c315b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:04.317615 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-19871705-47e6-4fee-a0ee-6d3e095c315b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:04.318092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-19871705-47e6-4fee-a0ee-6d3e095c315b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:04.318507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-19871705-47e6-4fee-a0ee-6d3e095c315b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:04.367424 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4f5e0dfd-d74b-469d-8d9b-0647d4a37bd4 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:04.367953 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4f5e0dfd-d74b-469d-8d9b-0647d4a37bd4 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:04.373844 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4f5e0dfd-d74b-469d-8d9b-0647d4a37bd4 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:04.374560 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4f5e0dfd-d74b-469d-8d9b-0647d4a37bd4 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:04.374988 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4f5e0dfd-d74b-469d-8d9b-0647d4a37bd4 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:04.375747 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4f5e0dfd-d74b-469d-8d9b-0647d4a37bd4 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:04.376180 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4f5e0dfd-d74b-469d-8d9b-0647d4a37bd4 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:04.376599 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4f5e0dfd-d74b-469d-8d9b-0647d4a37bd4 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:04.437654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4f5e0dfd-d74b-469d-8d9b-0647d4a37bd4 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:04.445814 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4f5e0dfd-d74b-469d-8d9b-0647d4a37bd4 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.082178 Aug 04 22:21:04.446394 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 72/136] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:04 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:04.452991 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-19871705-47e6-4fee-a0ee-6d3e095c315b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:04.460542 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-19871705-47e6-4fee-a0ee-6d3e095c315b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.155856 Aug 04 22:21:04.461095 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 65/137] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:04 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:04.478156 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5a593de6-ac98-49c7-9a68-88480efd32fe tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:04.478774 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5a593de6-ac98-49c7-9a68-88480efd32fe tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:04.484737 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5a593de6-ac98-49c7-9a68-88480efd32fe tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:04.485218 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5a593de6-ac98-49c7-9a68-88480efd32fe tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:04.485685 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5a593de6-ac98-49c7-9a68-88480efd32fe tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:04.486380 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5a593de6-ac98-49c7-9a68-88480efd32fe tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:04.486831 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5a593de6-ac98-49c7-9a68-88480efd32fe tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:04.487756 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5a593de6-ac98-49c7-9a68-88480efd32fe tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:04.623200 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5a593de6-ac98-49c7-9a68-88480efd32fe tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:04.636058 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5a593de6-ac98-49c7-9a68-88480efd32fe tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.161553 Aug 04 22:21:04.636703 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 73/138] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:04 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:04.995094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d850a025-e78d-4f5c-986d-8fbab0d0915c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:04.995704 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d850a025-e78d-4f5c-986d-8fbab0d0915c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:05.001937 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d850a025-e78d-4f5c-986d-8fbab0d0915c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:05.002420 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d850a025-e78d-4f5c-986d-8fbab0d0915c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:05.002964 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d850a025-e78d-4f5c-986d-8fbab0d0915c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:05.003673 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d850a025-e78d-4f5c-986d-8fbab0d0915c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:05.004125 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d850a025-e78d-4f5c-986d-8fbab0d0915c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:05.004552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d850a025-e78d-4f5c-986d-8fbab0d0915c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:05.131523 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d850a025-e78d-4f5c-986d-8fbab0d0915c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:05.139458 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d850a025-e78d-4f5c-986d-8fbab0d0915c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:05.140990 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d850a025-e78d-4f5c-986d-8fbab0d0915c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:05.142122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d850a025-e78d-4f5c-986d-8fbab0d0915c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.150910 Aug 04 22:21:05.142686 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 66/139] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:04 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:05.466614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d4e84eea-a6a0-4175-8cb1-676834dad2b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:05.467257 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d4e84eea-a6a0-4175-8cb1-676834dad2b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:05.474066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4e84eea-a6a0-4175-8cb1-676834dad2b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:05.474588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4e84eea-a6a0-4175-8cb1-676834dad2b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:05.475026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4e84eea-a6a0-4175-8cb1-676834dad2b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:05.475719 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4e84eea-a6a0-4175-8cb1-676834dad2b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:05.476256 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4e84eea-a6a0-4175-8cb1-676834dad2b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:05.476605 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4e84eea-a6a0-4175-8cb1-676834dad2b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:05.479818 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-40d042fe-fda5-48d5-84f3-3d85759db083 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:05.480438 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-40d042fe-fda5-48d5-84f3-3d85759db083 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:05.486615 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-40d042fe-fda5-48d5-84f3-3d85759db083 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:05.487163 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-40d042fe-fda5-48d5-84f3-3d85759db083 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:05.487578 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-40d042fe-fda5-48d5-84f3-3d85759db083 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:05.488273 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-40d042fe-fda5-48d5-84f3-3d85759db083 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:05.488731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-40d042fe-fda5-48d5-84f3-3d85759db083 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:05.489173 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-40d042fe-fda5-48d5-84f3-3d85759db083 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:05.538438 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d4e84eea-a6a0-4175-8cb1-676834dad2b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:05.545766 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d4e84eea-a6a0-4175-8cb1-676834dad2b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.082940 Aug 04 22:21:05.546329 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 74/140] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:05 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:05.617799 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-40d042fe-fda5-48d5-84f3-3d85759db083 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:05.625478 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-40d042fe-fda5-48d5-84f3-3d85759db083 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.149405 Aug 04 22:21:05.626039 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 67/141] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:05 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:05.656648 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4cd0a0ea-a4eb-4877-82b1-f51b83001212 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:05.657256 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4cd0a0ea-a4eb-4877-82b1-f51b83001212 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:05.663492 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4cd0a0ea-a4eb-4877-82b1-f51b83001212 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:05.663962 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4cd0a0ea-a4eb-4877-82b1-f51b83001212 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:05.664384 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4cd0a0ea-a4eb-4877-82b1-f51b83001212 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:05.665057 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4cd0a0ea-a4eb-4877-82b1-f51b83001212 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:05.665527 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4cd0a0ea-a4eb-4877-82b1-f51b83001212 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:05.665943 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4cd0a0ea-a4eb-4877-82b1-f51b83001212 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:05.794065 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4cd0a0ea-a4eb-4877-82b1-f51b83001212 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:05.801570 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4cd0a0ea-a4eb-4877-82b1-f51b83001212 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.148578 Aug 04 22:21:05.802131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 75/142] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:05 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:06.164884 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ddbd48aa-1011-48fb-b64a-60b92df376d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:06.165517 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ddbd48aa-1011-48fb-b64a-60b92df376d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:06.171436 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ddbd48aa-1011-48fb-b64a-60b92df376d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:06.171917 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ddbd48aa-1011-48fb-b64a-60b92df376d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:06.172350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ddbd48aa-1011-48fb-b64a-60b92df376d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:06.173033 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ddbd48aa-1011-48fb-b64a-60b92df376d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:06.173517 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ddbd48aa-1011-48fb-b64a-60b92df376d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:06.173939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ddbd48aa-1011-48fb-b64a-60b92df376d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:06.303340 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ddbd48aa-1011-48fb-b64a-60b92df376d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:06.311290 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ddbd48aa-1011-48fb-b64a-60b92df376d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:06.312784 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ddbd48aa-1011-48fb-b64a-60b92df376d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:06.313914 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ddbd48aa-1011-48fb-b64a-60b92df376d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.153041 Aug 04 22:21:06.314508 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 68/143] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:06 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:06.567000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d6217ce8-c88a-4b87-9299-87c6755eaac1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:06.567523 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d6217ce8-c88a-4b87-9299-87c6755eaac1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:06.573553 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6217ce8-c88a-4b87-9299-87c6755eaac1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:06.574041 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6217ce8-c88a-4b87-9299-87c6755eaac1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:06.574477 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6217ce8-c88a-4b87-9299-87c6755eaac1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:06.575163 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6217ce8-c88a-4b87-9299-87c6755eaac1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:06.575618 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6217ce8-c88a-4b87-9299-87c6755eaac1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:06.576043 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6217ce8-c88a-4b87-9299-87c6755eaac1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:06.636655 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d6217ce8-c88a-4b87-9299-87c6755eaac1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:06.644748 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d6217ce8-c88a-4b87-9299-87c6755eaac1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.082376 Aug 04 22:21:06.645333 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 76/144] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:06 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:06.646501 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-939f887a-fc07-4f2f-bb69-6d32bd3efc3e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:06.647118 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-939f887a-fc07-4f2f-bb69-6d32bd3efc3e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:06.652910 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-939f887a-fc07-4f2f-bb69-6d32bd3efc3e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:06.657308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-939f887a-fc07-4f2f-bb69-6d32bd3efc3e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:06.657308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-939f887a-fc07-4f2f-bb69-6d32bd3efc3e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:06.657308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-939f887a-fc07-4f2f-bb69-6d32bd3efc3e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:06.657308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-939f887a-fc07-4f2f-bb69-6d32bd3efc3e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:06.657816 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-939f887a-fc07-4f2f-bb69-6d32bd3efc3e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:06.782161 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-939f887a-fc07-4f2f-bb69-6d32bd3efc3e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:06.789511 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-939f887a-fc07-4f2f-bb69-6d32bd3efc3e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.147260 Aug 04 22:21:06.790080 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 69/145] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:06 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:06.822137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ce7791f3-cf4f-4c17-a915-a7b95fd63098 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:06.822675 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ce7791f3-cf4f-4c17-a915-a7b95fd63098 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:06.828526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce7791f3-cf4f-4c17-a915-a7b95fd63098 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:06.828994 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce7791f3-cf4f-4c17-a915-a7b95fd63098 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:06.829430 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce7791f3-cf4f-4c17-a915-a7b95fd63098 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:06.830117 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce7791f3-cf4f-4c17-a915-a7b95fd63098 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:06.830557 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce7791f3-cf4f-4c17-a915-a7b95fd63098 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:06.831075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce7791f3-cf4f-4c17-a915-a7b95fd63098 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:06.845601 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:06.961558 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-ce7791f3-cf4f-4c17-a915-a7b95fd63098 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:06.968991 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ce7791f3-cf4f-4c17-a915-a7b95fd63098 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.150669 Aug 04 22:21:06.969585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 77/146] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:06 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:07.336973 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1ea24fb5-78da-4195-90d2-7a80f0af0caf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:07.337628 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1ea24fb5-78da-4195-90d2-7a80f0af0caf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:07.343493 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1ea24fb5-78da-4195-90d2-7a80f0af0caf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:07.343982 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1ea24fb5-78da-4195-90d2-7a80f0af0caf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:07.344416 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1ea24fb5-78da-4195-90d2-7a80f0af0caf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:07.345104 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1ea24fb5-78da-4195-90d2-7a80f0af0caf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:07.345593 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1ea24fb5-78da-4195-90d2-7a80f0af0caf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:07.346031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1ea24fb5-78da-4195-90d2-7a80f0af0caf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:07.486825 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1ea24fb5-78da-4195-90d2-7a80f0af0caf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:07.495587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1ea24fb5-78da-4195-90d2-7a80f0af0caf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:07.497349 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1ea24fb5-78da-4195-90d2-7a80f0af0caf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:07.498725 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1ea24fb5-78da-4195-90d2-7a80f0af0caf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.165695 Aug 04 22:21:07.499548 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 70/147] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:07 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:07.665301 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-94101e55-61f1-4512-8b8b-581b6333b670 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:07.666291 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-94101e55-61f1-4512-8b8b-581b6333b670 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:07.673318 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94101e55-61f1-4512-8b8b-581b6333b670 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:07.674397 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94101e55-61f1-4512-8b8b-581b6333b670 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:07.674745 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94101e55-61f1-4512-8b8b-581b6333b670 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:07.676512 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94101e55-61f1-4512-8b8b-581b6333b670 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:07.676924 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94101e55-61f1-4512-8b8b-581b6333b670 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:07.677376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94101e55-61f1-4512-8b8b-581b6333b670 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:07.755538 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-94101e55-61f1-4512-8b8b-581b6333b670 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:07.770723 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-94101e55-61f1-4512-8b8b-581b6333b670 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.109100 Aug 04 22:21:07.785196 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 78/148] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:07 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:07.811252 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-93f135ee-40d8-42ec-86c6-2de2b70740f1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:07.812312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-93f135ee-40d8-42ec-86c6-2de2b70740f1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:07.820021 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93f135ee-40d8-42ec-86c6-2de2b70740f1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:07.820926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93f135ee-40d8-42ec-86c6-2de2b70740f1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:07.821370 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93f135ee-40d8-42ec-86c6-2de2b70740f1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:07.822267 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93f135ee-40d8-42ec-86c6-2de2b70740f1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:07.822952 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93f135ee-40d8-42ec-86c6-2de2b70740f1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:07.823719 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93f135ee-40d8-42ec-86c6-2de2b70740f1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:07.991713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7f3c60ed-f262-470c-9f2b-b2eb30b897e5 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:07.992377 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7f3c60ed-f262-470c-9f2b-b2eb30b897e5 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:08.004219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7f3c60ed-f262-470c-9f2b-b2eb30b897e5 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:08.006587 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7f3c60ed-f262-470c-9f2b-b2eb30b897e5 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:08.007380 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7f3c60ed-f262-470c-9f2b-b2eb30b897e5 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:08.008195 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7f3c60ed-f262-470c-9f2b-b2eb30b897e5 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:08.008733 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7f3c60ed-f262-470c-9f2b-b2eb30b897e5 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:08.009540 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7f3c60ed-f262-470c-9f2b-b2eb30b897e5 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:08.011546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-93f135ee-40d8-42ec-86c6-2de2b70740f1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:08.019763 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-93f135ee-40d8-42ec-86c6-2de2b70740f1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.213165 Aug 04 22:21:08.021754 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 71/149] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:07 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:08.117509 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-10bdf34a-8dd6-4532-ac20-35d234d62f12 req-cc8a4ac8-e1f6-40ce-b88e-8cbe1aa30fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09", "name": "network-vif-plugged", "status": "completed", "tag": "1d5ab153-937c-4016-8c27-0e52680db3c0"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:21:08.128274 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-10bdf34a-8dd6-4532-ac20-35d234d62f12 req-cc8a4ac8-e1f6-40ce-b88e-8cbe1aa30fe8 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:08.128892 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-10bdf34a-8dd6-4532-ac20-35d234d62f12 req-cc8a4ac8-e1f6-40ce-b88e-8cbe1aa30fe8 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:08.129331 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-10bdf34a-8dd6-4532-ac20-35d234d62f12 req-cc8a4ac8-e1f6-40ce-b88e-8cbe1aa30fe8 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:08.147701 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-10bdf34a-8dd6-4532-ac20-35d234d62f12 req-cc8a4ac8-e1f6-40ce-b88e-8cbe1aa30fe8 service nova] Creating event network-vif-plugged:1d5ab153-937c-4016-8c27-0e52680db3c0 for instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 on hv-cinder-85221 Aug 04 22:21:08.153086 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-10bdf34a-8dd6-4532-ac20-35d234d62f12 req-cc8a4ac8-e1f6-40ce-b88e-8cbe1aa30fe8 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130152 Aug 04 22:21:08.166836 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 72/150] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:21:08.224471 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7f3c60ed-f262-470c-9f2b-b2eb30b897e5 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:08.235081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7f3c60ed-f262-470c-9f2b-b2eb30b897e5 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.247241 Aug 04 22:21:08.235675 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 79/151] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:07 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:08.525955 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a463e6d7-4eb2-4978-9147-1b60a89755e9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:08.526758 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a463e6d7-4eb2-4978-9147-1b60a89755e9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:08.534110 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a463e6d7-4eb2-4978-9147-1b60a89755e9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:08.534886 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a463e6d7-4eb2-4978-9147-1b60a89755e9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:08.535548 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a463e6d7-4eb2-4978-9147-1b60a89755e9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:08.536240 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a463e6d7-4eb2-4978-9147-1b60a89755e9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:08.536690 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a463e6d7-4eb2-4978-9147-1b60a89755e9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:08.537107 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a463e6d7-4eb2-4978-9147-1b60a89755e9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:08.686631 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a463e6d7-4eb2-4978-9147-1b60a89755e9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:08.696490 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a463e6d7-4eb2-4978-9147-1b60a89755e9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:08.698002 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a463e6d7-4eb2-4978-9147-1b60a89755e9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:08.699118 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a463e6d7-4eb2-4978-9147-1b60a89755e9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.178714 Aug 04 22:21:08.699701 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 73/152] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:08 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:08.793000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e20d61d3-34a9-4322-9920-952221a8ae25 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:08.796534 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e20d61d3-34a9-4322-9920-952221a8ae25 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:08.801171 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e20d61d3-34a9-4322-9920-952221a8ae25 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:08.801714 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e20d61d3-34a9-4322-9920-952221a8ae25 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:08.802202 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e20d61d3-34a9-4322-9920-952221a8ae25 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:08.802950 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e20d61d3-34a9-4322-9920-952221a8ae25 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:08.803620 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e20d61d3-34a9-4322-9920-952221a8ae25 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:08.805950 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e20d61d3-34a9-4322-9920-952221a8ae25 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:08.901961 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e20d61d3-34a9-4322-9920-952221a8ae25 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:08.936687 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e20d61d3-34a9-4322-9920-952221a8ae25 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1298 microversion: 2.1 time: 0.143485 Aug 04 22:21:08.939040 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 80/153] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:08 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:09.040652 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bc83c33d-74a3-44eb-a551-e17c7f6f73c5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:09.042343 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bc83c33d-74a3-44eb-a551-e17c7f6f73c5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:09.048840 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc83c33d-74a3-44eb-a551-e17c7f6f73c5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:09.049464 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc83c33d-74a3-44eb-a551-e17c7f6f73c5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:09.049985 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc83c33d-74a3-44eb-a551-e17c7f6f73c5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:09.051263 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc83c33d-74a3-44eb-a551-e17c7f6f73c5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:09.051774 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc83c33d-74a3-44eb-a551-e17c7f6f73c5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:09.053153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc83c33d-74a3-44eb-a551-e17c7f6f73c5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:09.260286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0d71303a-1919-4024-bcc2-fa44b992d030 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:09.260999 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0d71303a-1919-4024-bcc2-fa44b992d030 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:09.270662 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0d71303a-1919-4024-bcc2-fa44b992d030 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:09.272209 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0d71303a-1919-4024-bcc2-fa44b992d030 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:09.272729 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0d71303a-1919-4024-bcc2-fa44b992d030 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:09.277012 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0d71303a-1919-4024-bcc2-fa44b992d030 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:09.277715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0d71303a-1919-4024-bcc2-fa44b992d030 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:09.278239 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0d71303a-1919-4024-bcc2-fa44b992d030 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:09.960990 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0d71303a-1919-4024-bcc2-fa44b992d030 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:09.973445 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0d71303a-1919-4024-bcc2-fa44b992d030 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.715230 Aug 04 22:21:09.975100 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 81/154] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:09 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:09.986740 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-de540670-a81f-4186-a6a2-63e0bf50869c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:09.987372 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-de540670-a81f-4186-a6a2-63e0bf50869c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:09.995580 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de540670-a81f-4186-a6a2-63e0bf50869c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:09.996077 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de540670-a81f-4186-a6a2-63e0bf50869c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:09.996518 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de540670-a81f-4186-a6a2-63e0bf50869c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:09.997223 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de540670-a81f-4186-a6a2-63e0bf50869c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:09.997712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de540670-a81f-4186-a6a2-63e0bf50869c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:09.998139 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de540670-a81f-4186-a6a2-63e0bf50869c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:10.041730 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bc83c33d-74a3-44eb-a551-e17c7f6f73c5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:10.044009 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=100 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:10.070715 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bc83c33d-74a3-44eb-a551-e17c7f6f73c5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 1.029489 Aug 04 22:21:10.071425 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 74/155] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:09 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:10.076396 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-381f2d47-bc72-4ef0-868f-4ea841e9b8c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:10.077039 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-381f2d47-bc72-4ef0-868f-4ea841e9b8c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:10.112058 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-381f2d47-bc72-4ef0-868f-4ea841e9b8c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:10.114381 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-381f2d47-bc72-4ef0-868f-4ea841e9b8c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:10.115715 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-381f2d47-bc72-4ef0-868f-4ea841e9b8c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:10.116779 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-381f2d47-bc72-4ef0-868f-4ea841e9b8c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:10.117236 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-381f2d47-bc72-4ef0-868f-4ea841e9b8c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:10.117829 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-381f2d47-bc72-4ef0-868f-4ea841e9b8c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:10.389704 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-381f2d47-bc72-4ef0-868f-4ea841e9b8c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:10.406787 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-381f2d47-bc72-4ef0-868f-4ea841e9b8c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1304 microversion: 2.1 time: 0.332464 Aug 04 22:21:10.408454 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 75/156] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:10 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1304 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:10.533043 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-de540670-a81f-4186-a6a2-63e0bf50869c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:10.551554 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-de540670-a81f-4186-a6a2-63e0bf50869c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:10.554170 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-de540670-a81f-4186-a6a2-63e0bf50869c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:10.555923 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-de540670-a81f-4186-a6a2-63e0bf50869c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.577414 Aug 04 22:21:10.556806 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 82/157] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:09 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:10.998246 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1aad2973-6fb6-4575-a321-beb9d8ad5bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:10.999408 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1aad2973-6fb6-4575-a321-beb9d8ad5bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:11.013016 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1aad2973-6fb6-4575-a321-beb9d8ad5bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:11.015479 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1aad2973-6fb6-4575-a321-beb9d8ad5bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:11.016098 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1aad2973-6fb6-4575-a321-beb9d8ad5bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:11.017696 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1aad2973-6fb6-4575-a321-beb9d8ad5bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:11.020155 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1aad2973-6fb6-4575-a321-beb9d8ad5bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:11.023225 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1aad2973-6fb6-4575-a321-beb9d8ad5bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:11.091527 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-55359a47-de5c-45d6-b8cd-799f6cc4085e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:11.092129 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-55359a47-de5c-45d6-b8cd-799f6cc4085e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:11.100263 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55359a47-de5c-45d6-b8cd-799f6cc4085e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:11.104319 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55359a47-de5c-45d6-b8cd-799f6cc4085e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:11.105176 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55359a47-de5c-45d6-b8cd-799f6cc4085e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:11.106140 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55359a47-de5c-45d6-b8cd-799f6cc4085e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:11.106767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55359a47-de5c-45d6-b8cd-799f6cc4085e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:11.108427 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55359a47-de5c-45d6-b8cd-799f6cc4085e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:11.481322 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-55359a47-de5c-45d6-b8cd-799f6cc4085e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:11.489575 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-55359a47-de5c-45d6-b8cd-799f6cc4085e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.401734 Aug 04 22:21:11.495554 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 83/158] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:11 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:11.500673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-345e0ee7-fa01-4c21-8d48-a773daf7ff02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:11.506410 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-345e0ee7-fa01-4c21-8d48-a773daf7ff02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:11.521163 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-345e0ee7-fa01-4c21-8d48-a773daf7ff02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:11.522911 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-345e0ee7-fa01-4c21-8d48-a773daf7ff02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:11.525941 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-345e0ee7-fa01-4c21-8d48-a773daf7ff02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:11.526860 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-345e0ee7-fa01-4c21-8d48-a773daf7ff02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:11.527257 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-345e0ee7-fa01-4c21-8d48-a773daf7ff02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:11.528132 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-345e0ee7-fa01-4c21-8d48-a773daf7ff02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:11.569430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1aad2973-6fb6-4575-a321-beb9d8ad5bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:11.585170 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1aad2973-6fb6-4575-a321-beb9d8ad5bb8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.590756 Aug 04 22:21:11.590493 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 76/159] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:10 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:11.603137 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a7c599a9-854b-4844-9d8b-63e5091aeac2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:11.603787 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a7c599a9-854b-4844-9d8b-63e5091aeac2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:11.616737 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=96 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:11.617120 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-345e0ee7-fa01-4c21-8d48-a773daf7ff02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:11.627119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-345e0ee7-fa01-4c21-8d48-a773daf7ff02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1304 microversion: 2.1 time: 0.130311 Aug 04 22:21:11.628822 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 84/160] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:11 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:11.632591 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a7c599a9-854b-4844-9d8b-63e5091aeac2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:11.633089 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a7c599a9-854b-4844-9d8b-63e5091aeac2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:11.633567 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a7c599a9-854b-4844-9d8b-63e5091aeac2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:11.634276 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a7c599a9-854b-4844-9d8b-63e5091aeac2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:11.646793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a7c599a9-854b-4844-9d8b-63e5091aeac2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:11.647254 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a7c599a9-854b-4844-9d8b-63e5091aeac2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:11.902052 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-47307620-caf7-4b51-9009-27f83769dabc req-a7914b94-60a1-4813-9a33-ec096166595a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb440660-4715-48f6-a7ff-f0b74dfefe21", "name": "network-vif-plugged", "status": "completed", "tag": "417dd402-4a58-49ce-a237-c5d14b0ce44d"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:21:11.923355 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-47307620-caf7-4b51-9009-27f83769dabc req-a7914b94-60a1-4813-9a33-ec096166595a service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:11.924010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-47307620-caf7-4b51-9009-27f83769dabc req-a7914b94-60a1-4813-9a33-ec096166595a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:11.924540 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-47307620-caf7-4b51-9009-27f83769dabc req-a7914b94-60a1-4813-9a33-ec096166595a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:11.951624 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-47307620-caf7-4b51-9009-27f83769dabc req-a7914b94-60a1-4813-9a33-ec096166595a service nova] Creating event network-vif-plugged:417dd402-4a58-49ce-a237-c5d14b0ce44d for instance eb440660-4715-48f6-a7ff-f0b74dfefe21 on hv-cinder-85221 Aug 04 22:21:11.968752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-47307620-caf7-4b51-9009-27f83769dabc req-a7914b94-60a1-4813-9a33-ec096166595a service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071318 Aug 04 22:21:11.973721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 85/161] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:21:12.203366 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a7c599a9-854b-4844-9d8b-63e5091aeac2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:12.218321 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a7c599a9-854b-4844-9d8b-63e5091aeac2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:12.223532 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a7c599a9-854b-4844-9d8b-63e5091aeac2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:12.228081 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a7c599a9-854b-4844-9d8b-63e5091aeac2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.636156 Aug 04 22:21:12.229138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 77/162] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:11 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:12.516786 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-96b54d4b-f163-43aa-997d-f10e55d430bf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:12.517607 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-96b54d4b-f163-43aa-997d-f10e55d430bf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:12.530100 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-96b54d4b-f163-43aa-997d-f10e55d430bf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:12.530599 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-96b54d4b-f163-43aa-997d-f10e55d430bf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:12.531716 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-96b54d4b-f163-43aa-997d-f10e55d430bf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:12.532714 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-96b54d4b-f163-43aa-997d-f10e55d430bf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:12.533367 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-96b54d4b-f163-43aa-997d-f10e55d430bf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:12.533888 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-96b54d4b-f163-43aa-997d-f10e55d430bf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:12.615322 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c6743c77-510b-4da2-96ab-83aa2300ccfa tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:12.616036 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c6743c77-510b-4da2-96ab-83aa2300ccfa tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:12.629148 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c6743c77-510b-4da2-96ab-83aa2300ccfa tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:12.629856 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c6743c77-510b-4da2-96ab-83aa2300ccfa tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:12.630400 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c6743c77-510b-4da2-96ab-83aa2300ccfa tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:12.631266 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c6743c77-510b-4da2-96ab-83aa2300ccfa tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:12.633804 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c6743c77-510b-4da2-96ab-83aa2300ccfa tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:12.634814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c6743c77-510b-4da2-96ab-83aa2300ccfa tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:12.772678 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-96b54d4b-f163-43aa-997d-f10e55d430bf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:12.780945 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-96b54d4b-f163-43aa-997d-f10e55d430bf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.269811 Aug 04 22:21:12.786172 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 86/163] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:12 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:12.790911 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6adc6307-fa84-4c45-8702-956f6949109b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:12.792610 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6adc6307-fa84-4c45-8702-956f6949109b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:12.808725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6adc6307-fa84-4c45-8702-956f6949109b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:12.811634 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6adc6307-fa84-4c45-8702-956f6949109b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:12.812492 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6adc6307-fa84-4c45-8702-956f6949109b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:12.815308 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6adc6307-fa84-4c45-8702-956f6949109b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:12.816734 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6adc6307-fa84-4c45-8702-956f6949109b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:12.821326 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6adc6307-fa84-4c45-8702-956f6949109b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:12.824163 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c6743c77-510b-4da2-96ab-83aa2300ccfa tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:12.832677 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c6743c77-510b-4da2-96ab-83aa2300ccfa tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.224628 Aug 04 22:21:12.842003 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 78/164] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:12 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:13.012029 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6adc6307-fa84-4c45-8702-956f6949109b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:13.022113 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6adc6307-fa84-4c45-8702-956f6949109b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.234728 Aug 04 22:21:13.036290 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 87/165] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:12 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:13.254082 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9cc645be-06d4-4a51-86a1-101f332eb04f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:13.254691 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-9cc645be-06d4-4a51-86a1-101f332eb04f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:13.260519 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9cc645be-06d4-4a51-86a1-101f332eb04f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:13.261001 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9cc645be-06d4-4a51-86a1-101f332eb04f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:13.261459 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9cc645be-06d4-4a51-86a1-101f332eb04f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:13.262158 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9cc645be-06d4-4a51-86a1-101f332eb04f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:13.262665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9cc645be-06d4-4a51-86a1-101f332eb04f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:13.263018 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9cc645be-06d4-4a51-86a1-101f332eb04f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:13.432885 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9cc645be-06d4-4a51-86a1-101f332eb04f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:13.442297 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9cc645be-06d4-4a51-86a1-101f332eb04f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:13.444606 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9cc645be-06d4-4a51-86a1-101f332eb04f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:13.446300 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9cc645be-06d4-4a51-86a1-101f332eb04f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.196565 Aug 04 22:21:13.447457 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 79/166] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:13 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:13.805295 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c74f88c2-048a-4fc9-9b27-0db17b594497 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:13.805931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c74f88c2-048a-4fc9-9b27-0db17b594497 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:13.811653 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c74f88c2-048a-4fc9-9b27-0db17b594497 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:13.812133 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c74f88c2-048a-4fc9-9b27-0db17b594497 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:13.812557 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c74f88c2-048a-4fc9-9b27-0db17b594497 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:13.816970 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c74f88c2-048a-4fc9-9b27-0db17b594497 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:13.816970 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c74f88c2-048a-4fc9-9b27-0db17b594497 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:13.816970 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c74f88c2-048a-4fc9-9b27-0db17b594497 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:13.855986 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7e744981-6c51-41cc-b5f2-b438af86b7ce tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:13.857317 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7e744981-6c51-41cc-b5f2-b438af86b7ce tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:13.864047 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e744981-6c51-41cc-b5f2-b438af86b7ce tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:13.864543 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e744981-6c51-41cc-b5f2-b438af86b7ce tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:13.864980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e744981-6c51-41cc-b5f2-b438af86b7ce tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:13.865713 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e744981-6c51-41cc-b5f2-b438af86b7ce tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:13.866171 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e744981-6c51-41cc-b5f2-b438af86b7ce tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:13.866625 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e744981-6c51-41cc-b5f2-b438af86b7ce tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:13.957927 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c74f88c2-048a-4fc9-9b27-0db17b594497 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:13.967443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c74f88c2-048a-4fc9-9b27-0db17b594497 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.165846 Aug 04 22:21:13.976130 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 88/167] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:13 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:14.010820 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7e744981-6c51-41cc-b5f2-b438af86b7ce tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:14.018344 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7e744981-6c51-41cc-b5f2-b438af86b7ce tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.166200 Aug 04 22:21:14.019541 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 80/168] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:13 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:14.043312 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d1d8e346-eda0-471c-909e-46ea9b710ed5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:14.043926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d1d8e346-eda0-471c-909e-46ea9b710ed5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:14.049880 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1d8e346-eda0-471c-909e-46ea9b710ed5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:14.050386 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1d8e346-eda0-471c-909e-46ea9b710ed5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:14.050967 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1d8e346-eda0-471c-909e-46ea9b710ed5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:14.051735 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1d8e346-eda0-471c-909e-46ea9b710ed5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:14.052196 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1d8e346-eda0-471c-909e-46ea9b710ed5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:14.052620 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1d8e346-eda0-471c-909e-46ea9b710ed5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:14.189557 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d1d8e346-eda0-471c-909e-46ea9b710ed5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:14.197936 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d1d8e346-eda0-471c-909e-46ea9b710ed5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.158305 Aug 04 22:21:14.198612 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 89/169] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:14 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:14.469073 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-67c16441-fa08-4e1e-9a28-e67ed4a76d22 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:14.469710 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-67c16441-fa08-4e1e-9a28-e67ed4a76d22 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:14.475948 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-67c16441-fa08-4e1e-9a28-e67ed4a76d22 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:14.476436 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-67c16441-fa08-4e1e-9a28-e67ed4a76d22 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:14.476880 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-67c16441-fa08-4e1e-9a28-e67ed4a76d22 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:14.477612 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-67c16441-fa08-4e1e-9a28-e67ed4a76d22 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:14.478092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-67c16441-fa08-4e1e-9a28-e67ed4a76d22 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:14.478519 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-67c16441-fa08-4e1e-9a28-e67ed4a76d22 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:14.609914 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-67c16441-fa08-4e1e-9a28-e67ed4a76d22 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:14.617859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-67c16441-fa08-4e1e-9a28-e67ed4a76d22 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:14.619545 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-67c16441-fa08-4e1e-9a28-e67ed4a76d22 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:14.620547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-67c16441-fa08-4e1e-9a28-e67ed4a76d22 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.155342 Aug 04 22:21:14.621106 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 81/170] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:14 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:14.990511 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-67855569-65d9-42e5-aa36-28a9664d360f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:14.991032 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-67855569-65d9-42e5-aa36-28a9664d360f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:14.997191 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-67855569-65d9-42e5-aa36-28a9664d360f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:14.997701 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-67855569-65d9-42e5-aa36-28a9664d360f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:14.998131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-67855569-65d9-42e5-aa36-28a9664d360f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:14.999081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-67855569-65d9-42e5-aa36-28a9664d360f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:14.999535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-67855569-65d9-42e5-aa36-28a9664d360f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:14.999953 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-67855569-65d9-42e5-aa36-28a9664d360f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:15.040220 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-78da672c-ec20-4ca1-9354-2f80e3628146 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:15.040866 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-78da672c-ec20-4ca1-9354-2f80e3628146 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:15.046789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78da672c-ec20-4ca1-9354-2f80e3628146 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:15.047280 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78da672c-ec20-4ca1-9354-2f80e3628146 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:15.047718 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78da672c-ec20-4ca1-9354-2f80e3628146 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:15.048412 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78da672c-ec20-4ca1-9354-2f80e3628146 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:15.048867 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78da672c-ec20-4ca1-9354-2f80e3628146 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:15.049293 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78da672c-ec20-4ca1-9354-2f80e3628146 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:15.130457 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-67855569-65d9-42e5-aa36-28a9664d360f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:15.138033 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-67855569-65d9-42e5-aa36-28a9664d360f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.152467 Aug 04 22:21:15.138879 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 90/171] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:14 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:15.179782 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-78da672c-ec20-4ca1-9354-2f80e3628146 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:15.187143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-78da672c-ec20-4ca1-9354-2f80e3628146 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.150864 Aug 04 22:21:15.187715 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 82/172] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:15 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:15.218910 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ada3f1c6-6298-437b-a62c-46ce4f8a7308 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:15.219509 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ada3f1c6-6298-437b-a62c-46ce4f8a7308 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:15.225989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ada3f1c6-6298-437b-a62c-46ce4f8a7308 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:15.226461 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ada3f1c6-6298-437b-a62c-46ce4f8a7308 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:15.226886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ada3f1c6-6298-437b-a62c-46ce4f8a7308 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:15.227556 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ada3f1c6-6298-437b-a62c-46ce4f8a7308 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:15.227998 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ada3f1c6-6298-437b-a62c-46ce4f8a7308 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:15.228408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ada3f1c6-6298-437b-a62c-46ce4f8a7308 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:15.357360 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-ada3f1c6-6298-437b-a62c-46ce4f8a7308 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:15.364731 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ada3f1c6-6298-437b-a62c-46ce4f8a7308 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.149522 Aug 04 22:21:15.365294 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 91/173] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:15 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:15.643391 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-8c81c39e-736e-415e-b18d-3a6dbb1b572c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:15.644539 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-8c81c39e-736e-415e-b18d-3a6dbb1b572c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:15.650812 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c81c39e-736e-415e-b18d-3a6dbb1b572c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:15.651292 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c81c39e-736e-415e-b18d-3a6dbb1b572c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:15.651720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c81c39e-736e-415e-b18d-3a6dbb1b572c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:15.652478 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c81c39e-736e-415e-b18d-3a6dbb1b572c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:15.652843 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c81c39e-736e-415e-b18d-3a6dbb1b572c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:15.653261 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c81c39e-736e-415e-b18d-3a6dbb1b572c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:15.783606 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8c81c39e-736e-415e-b18d-3a6dbb1b572c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:15.792622 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8c81c39e-736e-415e-b18d-3a6dbb1b572c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:15.794174 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8c81c39e-736e-415e-b18d-3a6dbb1b572c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:15.795305 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-8c81c39e-736e-415e-b18d-3a6dbb1b572c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.155782 Aug 04 22:21:15.796287 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 83/174] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:15 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:16.158658 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-34834e10-f4b4-4f0e-881c-076a59dd3ae7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:16.159790 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-34834e10-f4b4-4f0e-881c-076a59dd3ae7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:16.165764 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-34834e10-f4b4-4f0e-881c-076a59dd3ae7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:16.166274 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-34834e10-f4b4-4f0e-881c-076a59dd3ae7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:16.166710 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-34834e10-f4b4-4f0e-881c-076a59dd3ae7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:16.167402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-34834e10-f4b4-4f0e-881c-076a59dd3ae7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:16.167852 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-34834e10-f4b4-4f0e-881c-076a59dd3ae7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:16.168271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-34834e10-f4b4-4f0e-881c-076a59dd3ae7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:16.208787 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-37131a91-da67-4c82-ab47-a36e6da4e705 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:16.209547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-37131a91-da67-4c82-ab47-a36e6da4e705 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:16.215555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-37131a91-da67-4c82-ab47-a36e6da4e705 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:16.216053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-37131a91-da67-4c82-ab47-a36e6da4e705 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:16.216492 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-37131a91-da67-4c82-ab47-a36e6da4e705 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:16.217197 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-37131a91-da67-4c82-ab47-a36e6da4e705 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:16.217690 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-37131a91-da67-4c82-ab47-a36e6da4e705 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:16.218119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-37131a91-da67-4c82-ab47-a36e6da4e705 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:16.301181 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-34834e10-f4b4-4f0e-881c-076a59dd3ae7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:16.308862 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-34834e10-f4b4-4f0e-881c-076a59dd3ae7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.154034 Aug 04 22:21:16.309452 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 92/175] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:16 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:16.348034 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-37131a91-da67-4c82-ab47-a36e6da4e705 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:16.355438 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-37131a91-da67-4c82-ab47-a36e6da4e705 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.151191 Aug 04 22:21:16.356004 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 84/176] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:16 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:16.385226 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-68501627-5d0f-4d63-95c1-a7870f25d368 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:16.385781 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-68501627-5d0f-4d63-95c1-a7870f25d368 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:16.391660 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68501627-5d0f-4d63-95c1-a7870f25d368 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:16.392137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68501627-5d0f-4d63-95c1-a7870f25d368 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:16.392567 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68501627-5d0f-4d63-95c1-a7870f25d368 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:16.393253 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68501627-5d0f-4d63-95c1-a7870f25d368 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:16.394303 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68501627-5d0f-4d63-95c1-a7870f25d368 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:16.394835 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68501627-5d0f-4d63-95c1-a7870f25d368 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:16.530654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-68501627-5d0f-4d63-95c1-a7870f25d368 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:16.539081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-68501627-5d0f-4d63-95c1-a7870f25d368 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.157681 Aug 04 22:21:16.539655 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 93/177] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:16 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:16.819133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-75b1d2cc-172e-415b-bad5-3e4a842f256d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:16.819801 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-75b1d2cc-172e-415b-bad5-3e4a842f256d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:16.826081 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75b1d2cc-172e-415b-bad5-3e4a842f256d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:16.826836 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75b1d2cc-172e-415b-bad5-3e4a842f256d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:16.827445 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75b1d2cc-172e-415b-bad5-3e4a842f256d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:16.828150 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75b1d2cc-172e-415b-bad5-3e4a842f256d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:16.828810 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75b1d2cc-172e-415b-bad5-3e4a842f256d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:16.829231 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75b1d2cc-172e-415b-bad5-3e4a842f256d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:16.972888 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-75b1d2cc-172e-415b-bad5-3e4a842f256d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:16.981040 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-75b1d2cc-172e-415b-bad5-3e4a842f256d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:16.982693 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-75b1d2cc-172e-415b-bad5-3e4a842f256d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:16.983896 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-75b1d2cc-172e-415b-bad5-3e4a842f256d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.169790 Aug 04 22:21:16.984516 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 85/178] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:16 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:17.330495 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c9897b6a-0d6d-47d1-9ae3-17daf5ccd9b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:17.331615 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c9897b6a-0d6d-47d1-9ae3-17daf5ccd9b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:17.334203 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:17.339489 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c9897b6a-0d6d-47d1-9ae3-17daf5ccd9b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:17.339966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c9897b6a-0d6d-47d1-9ae3-17daf5ccd9b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:17.340398 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c9897b6a-0d6d-47d1-9ae3-17daf5ccd9b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:17.341084 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c9897b6a-0d6d-47d1-9ae3-17daf5ccd9b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:17.341565 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c9897b6a-0d6d-47d1-9ae3-17daf5ccd9b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:17.341987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c9897b6a-0d6d-47d1-9ae3-17daf5ccd9b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:17.376092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-88f8691b-2f49-483e-aa10-125dd16d00d1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:17.376715 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-88f8691b-2f49-483e-aa10-125dd16d00d1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:17.383407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88f8691b-2f49-483e-aa10-125dd16d00d1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:17.383901 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88f8691b-2f49-483e-aa10-125dd16d00d1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:17.384335 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88f8691b-2f49-483e-aa10-125dd16d00d1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:17.385039 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88f8691b-2f49-483e-aa10-125dd16d00d1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:17.385597 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88f8691b-2f49-483e-aa10-125dd16d00d1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:17.386025 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88f8691b-2f49-483e-aa10-125dd16d00d1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:17.477771 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c9897b6a-0d6d-47d1-9ae3-17daf5ccd9b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:17.479957 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:17.486662 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c9897b6a-0d6d-47d1-9ae3-17daf5ccd9b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.159961 Aug 04 22:21:17.499956 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 94/179] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:17 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:17.532491 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-88f8691b-2f49-483e-aa10-125dd16d00d1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:17.540587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-88f8691b-2f49-483e-aa10-125dd16d00d1 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1318 microversion: 2.1 time: 0.168487 Aug 04 22:21:17.541254 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 86/180] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:17 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:17.559838 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1d18cee4-b8a7-46ca-ad70-29b69809f603 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:17.560453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1d18cee4-b8a7-46ca-ad70-29b69809f603 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:17.566949 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1d18cee4-b8a7-46ca-ad70-29b69809f603 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:17.567435 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1d18cee4-b8a7-46ca-ad70-29b69809f603 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:17.567868 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1d18cee4-b8a7-46ca-ad70-29b69809f603 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:17.568572 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1d18cee4-b8a7-46ca-ad70-29b69809f603 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:17.569026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1d18cee4-b8a7-46ca-ad70-29b69809f603 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:17.569475 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1d18cee4-b8a7-46ca-ad70-29b69809f603 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:17.706873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1d18cee4-b8a7-46ca-ad70-29b69809f603 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:17.715249 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1d18cee4-b8a7-46ca-ad70-29b69809f603 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.159248 Aug 04 22:21:17.715807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 95/181] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:17 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:18.007098 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c56748d7-3eb0-4bf3-9f41-ea4bfd25f7a5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:18.007721 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c56748d7-3eb0-4bf3-9f41-ea4bfd25f7a5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:18.013564 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c56748d7-3eb0-4bf3-9f41-ea4bfd25f7a5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:18.014053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c56748d7-3eb0-4bf3-9f41-ea4bfd25f7a5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:18.014489 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c56748d7-3eb0-4bf3-9f41-ea4bfd25f7a5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:18.015180 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c56748d7-3eb0-4bf3-9f41-ea4bfd25f7a5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:18.015635 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c56748d7-3eb0-4bf3-9f41-ea4bfd25f7a5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:18.016059 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c56748d7-3eb0-4bf3-9f41-ea4bfd25f7a5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:18.166412 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c56748d7-3eb0-4bf3-9f41-ea4bfd25f7a5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:18.176573 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c56748d7-3eb0-4bf3-9f41-ea4bfd25f7a5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:18.178572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c56748d7-3eb0-4bf3-9f41-ea4bfd25f7a5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:18.179717 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c56748d7-3eb0-4bf3-9f41-ea4bfd25f7a5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.176800 Aug 04 22:21:18.180384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 87/182] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:18 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:18.508314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0f01d7e5-7083-49b7-b95c-628b3f616440 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:18.509111 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0f01d7e5-7083-49b7-b95c-628b3f616440 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:18.517481 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f01d7e5-7083-49b7-b95c-628b3f616440 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:18.518105 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f01d7e5-7083-49b7-b95c-628b3f616440 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:18.518701 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f01d7e5-7083-49b7-b95c-628b3f616440 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:18.519753 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f01d7e5-7083-49b7-b95c-628b3f616440 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:18.520449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f01d7e5-7083-49b7-b95c-628b3f616440 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:18.520968 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f01d7e5-7083-49b7-b95c-628b3f616440 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:18.561372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-53334464-d2f5-452a-83a5-a1e9282fc861 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:18.562006 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-53334464-d2f5-452a-83a5-a1e9282fc861 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:18.576917 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-53334464-d2f5-452a-83a5-a1e9282fc861 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:18.577684 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-53334464-d2f5-452a-83a5-a1e9282fc861 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:18.578299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-53334464-d2f5-452a-83a5-a1e9282fc861 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:18.579178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-53334464-d2f5-452a-83a5-a1e9282fc861 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:18.579784 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-53334464-d2f5-452a-83a5-a1e9282fc861 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:18.580360 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-53334464-d2f5-452a-83a5-a1e9282fc861 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:18.682754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0f01d7e5-7083-49b7-b95c-628b3f616440 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:18.690260 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0f01d7e5-7083-49b7-b95c-628b3f616440 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.186661 Aug 04 22:21:18.691005 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 96/183] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:18 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:18.736146 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-686926f9-71dc-41c0-8d72-c6474a1e3cd0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:18.736856 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-686926f9-71dc-41c0-8d72-c6474a1e3cd0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:18.743055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-686926f9-71dc-41c0-8d72-c6474a1e3cd0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:18.743743 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-686926f9-71dc-41c0-8d72-c6474a1e3cd0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:18.744188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-686926f9-71dc-41c0-8d72-c6474a1e3cd0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:18.744893 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-686926f9-71dc-41c0-8d72-c6474a1e3cd0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:18.745346 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-686926f9-71dc-41c0-8d72-c6474a1e3cd0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:18.745791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-686926f9-71dc-41c0-8d72-c6474a1e3cd0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:18.873099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-53334464-d2f5-452a-83a5-a1e9282fc861 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:18.877065 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-686926f9-71dc-41c0-8d72-c6474a1e3cd0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:18.883191 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-53334464-d2f5-452a-83a5-a1e9282fc861 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1505 microversion: 2.1 time: 0.325500 Aug 04 22:21:18.884033 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 88/184] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:18 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:18.885233 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-686926f9-71dc-41c0-8d72-c6474a1e3cd0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.152957 Aug 04 22:21:18.885832 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 97/185] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:18 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:19.209223 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-93813a1c-3662-46cf-8845-6b8f4e4496c2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:19.210014 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-93813a1c-3662-46cf-8845-6b8f4e4496c2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:19.219572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93813a1c-3662-46cf-8845-6b8f4e4496c2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:19.221190 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93813a1c-3662-46cf-8845-6b8f4e4496c2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:19.221970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93813a1c-3662-46cf-8845-6b8f4e4496c2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:19.223122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93813a1c-3662-46cf-8845-6b8f4e4496c2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:19.224750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93813a1c-3662-46cf-8845-6b8f4e4496c2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:19.225908 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93813a1c-3662-46cf-8845-6b8f4e4496c2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:19.325635 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-4660aef4-e138-4d2f-a7a3-3c32ed4a537b req-9d13b225-f2a8-4a71-8883-d00b062e2a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9533fa0-d1ed-4df8-9a1f-d754b79c5394", "tag": "fd292742-5a95-4c85-9714-6d6e9bd7487f"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:21:19.335593 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-4660aef4-e138-4d2f-a7a3-3c32ed4a537b req-9d13b225-f2a8-4a71-8883-d00b062e2a98 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:19.336061 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-4660aef4-e138-4d2f-a7a3-3c32ed4a537b req-9d13b225-f2a8-4a71-8883-d00b062e2a98 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:19.336617 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-4660aef4-e138-4d2f-a7a3-3c32ed4a537b req-9d13b225-f2a8-4a71-8883-d00b062e2a98 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:19.348576 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-4660aef4-e138-4d2f-a7a3-3c32ed4a537b req-9d13b225-f2a8-4a71-8883-d00b062e2a98 service nova] Creating event network-changed:fd292742-5a95-4c85-9714-6d6e9bd7487f for instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 on hv-cinder-85221 Aug 04 22:21:19.353452 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-4660aef4-e138-4d2f-a7a3-3c32ed4a537b req-9d13b225-f2a8-4a71-8883-d00b062e2a98 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031546 Aug 04 22:21:19.354213 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 98/186] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:21:19.429765 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-93813a1c-3662-46cf-8845-6b8f4e4496c2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:19.437858 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-93813a1c-3662-46cf-8845-6b8f4e4496c2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:19.439519 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-93813a1c-3662-46cf-8845-6b8f4e4496c2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:19.441308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-93813a1c-3662-46cf-8845-6b8f4e4496c2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.240628 Aug 04 22:21:19.442255 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 89/187] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:19 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:19.710991 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6b1dec5b-038b-4dfb-bc35-eb8cd70fbac5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:19.711735 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6b1dec5b-038b-4dfb-bc35-eb8cd70fbac5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:19.717856 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b1dec5b-038b-4dfb-bc35-eb8cd70fbac5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:19.718343 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b1dec5b-038b-4dfb-bc35-eb8cd70fbac5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:19.718777 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b1dec5b-038b-4dfb-bc35-eb8cd70fbac5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:19.719490 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b1dec5b-038b-4dfb-bc35-eb8cd70fbac5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:19.719951 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b1dec5b-038b-4dfb-bc35-eb8cd70fbac5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:19.720376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b1dec5b-038b-4dfb-bc35-eb8cd70fbac5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:19.848050 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6b1dec5b-038b-4dfb-bc35-eb8cd70fbac5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:19.855731 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6b1dec5b-038b-4dfb-bc35-eb8cd70fbac5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.148849 Aug 04 22:21:19.856313 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 99/188] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:19 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:19.906106 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7f6d1154-b6bb-4ac5-ba9d-09eb5126e7c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:19.906721 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7f6d1154-b6bb-4ac5-ba9d-09eb5126e7c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:19.913809 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7f6d1154-b6bb-4ac5-ba9d-09eb5126e7c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:19.914292 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7f6d1154-b6bb-4ac5-ba9d-09eb5126e7c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:19.914727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7f6d1154-b6bb-4ac5-ba9d-09eb5126e7c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:19.915413 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7f6d1154-b6bb-4ac5-ba9d-09eb5126e7c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:19.915904 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7f6d1154-b6bb-4ac5-ba9d-09eb5126e7c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:19.916330 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7f6d1154-b6bb-4ac5-ba9d-09eb5126e7c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:20.053718 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7f6d1154-b6bb-4ac5-ba9d-09eb5126e7c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:20.061109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7f6d1154-b6bb-4ac5-ba9d-09eb5126e7c3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.158943 Aug 04 22:21:20.061720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 90/189] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:19 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:20.464216 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5646461f-d8d8-483a-8981-8969f6467141 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:20.464820 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5646461f-d8d8-483a-8981-8969f6467141 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:20.470771 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5646461f-d8d8-483a-8981-8969f6467141 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:20.471328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5646461f-d8d8-483a-8981-8969f6467141 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:20.471867 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5646461f-d8d8-483a-8981-8969f6467141 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:20.472511 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5646461f-d8d8-483a-8981-8969f6467141 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:20.472966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5646461f-d8d8-483a-8981-8969f6467141 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:20.473387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5646461f-d8d8-483a-8981-8969f6467141 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:20.614206 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5646461f-d8d8-483a-8981-8969f6467141 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:20.622131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5646461f-d8d8-483a-8981-8969f6467141 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:20.623884 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5646461f-d8d8-483a-8981-8969f6467141 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:20.624968 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5646461f-d8d8-483a-8981-8969f6467141 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.164645 Aug 04 22:21:20.625538 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 100/190] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:20 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:21:20.878356 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-35317864-1245-4bed-ba0b-e7f4972f5c13 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:20.879018 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-35317864-1245-4bed-ba0b-e7f4972f5c13 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:20.884932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-35317864-1245-4bed-ba0b-e7f4972f5c13 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:20.885438 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-35317864-1245-4bed-ba0b-e7f4972f5c13 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:20.885879 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-35317864-1245-4bed-ba0b-e7f4972f5c13 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:20.886563 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-35317864-1245-4bed-ba0b-e7f4972f5c13 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:20.887016 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-35317864-1245-4bed-ba0b-e7f4972f5c13 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:20.887438 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-35317864-1245-4bed-ba0b-e7f4972f5c13 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:20.901733 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=100 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:21.018300 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-35317864-1245-4bed-ba0b-e7f4972f5c13 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:21.025648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-35317864-1245-4bed-ba0b-e7f4972f5c13 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.152301 Aug 04 22:21:21.026633 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 91/191] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:20 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:21.081290 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9e8768d4-790b-4e49-ab1f-906663a438cb tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:21.081955 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9e8768d4-790b-4e49-ab1f-906663a438cb tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:21.087931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9e8768d4-790b-4e49-ab1f-906663a438cb tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:21.088408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9e8768d4-790b-4e49-ab1f-906663a438cb tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:21.088839 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9e8768d4-790b-4e49-ab1f-906663a438cb tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:21.089565 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9e8768d4-790b-4e49-ab1f-906663a438cb tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:21.090001 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9e8768d4-790b-4e49-ab1f-906663a438cb tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:21.090423 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9e8768d4-790b-4e49-ab1f-906663a438cb tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:21.216840 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9e8768d4-790b-4e49-ab1f-906663a438cb tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:21.224745 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9e8768d4-790b-4e49-ab1f-906663a438cb tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.147223 Aug 04 22:21:21.225318 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 101/192] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:21 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:21.647665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-58aae5ef-4180-4b13-accb-931efec62aa5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:21.648268 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-58aae5ef-4180-4b13-accb-931efec62aa5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:21.654227 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58aae5ef-4180-4b13-accb-931efec62aa5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:21.654705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58aae5ef-4180-4b13-accb-931efec62aa5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:21.655137 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58aae5ef-4180-4b13-accb-931efec62aa5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:21.655817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58aae5ef-4180-4b13-accb-931efec62aa5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:21.656263 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58aae5ef-4180-4b13-accb-931efec62aa5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:21.656699 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58aae5ef-4180-4b13-accb-931efec62aa5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:21.783867 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-58aae5ef-4180-4b13-accb-931efec62aa5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:21.792880 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-58aae5ef-4180-4b13-accb-931efec62aa5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:21.794430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-58aae5ef-4180-4b13-accb-931efec62aa5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:21.795610 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-58aae5ef-4180-4b13-accb-931efec62aa5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.152091 Aug 04 22:21:21.796178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 92/193] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:21 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:22.045657 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e83ca407-039f-4736-8be7-9c1f1c04410a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:22.046376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e83ca407-039f-4736-8be7-9c1f1c04410a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:22.054287 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e83ca407-039f-4736-8be7-9c1f1c04410a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:22.054778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e83ca407-039f-4736-8be7-9c1f1c04410a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:22.055210 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e83ca407-039f-4736-8be7-9c1f1c04410a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:22.056021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e83ca407-039f-4736-8be7-9c1f1c04410a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:22.056551 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e83ca407-039f-4736-8be7-9c1f1c04410a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:22.057104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e83ca407-039f-4736-8be7-9c1f1c04410a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:22.200397 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e83ca407-039f-4736-8be7-9c1f1c04410a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:22.208386 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e83ca407-039f-4736-8be7-9c1f1c04410a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.166557 Aug 04 22:21:22.209001 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 102/194] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:22 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:22.245987 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-98ce6411-b176-4309-8f85-3122b1ea6b90 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:22.246752 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-98ce6411-b176-4309-8f85-3122b1ea6b90 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:22.253537 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-98ce6411-b176-4309-8f85-3122b1ea6b90 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:22.254219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-98ce6411-b176-4309-8f85-3122b1ea6b90 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:22.254734 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-98ce6411-b176-4309-8f85-3122b1ea6b90 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:22.255526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-98ce6411-b176-4309-8f85-3122b1ea6b90 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:22.256060 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-98ce6411-b176-4309-8f85-3122b1ea6b90 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:22.256557 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-98ce6411-b176-4309-8f85-3122b1ea6b90 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:22.397335 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-98ce6411-b176-4309-8f85-3122b1ea6b90 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:22.404953 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-98ce6411-b176-4309-8f85-3122b1ea6b90 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.162845 Aug 04 22:21:22.405556 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 93/195] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:22 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:22.820253 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4be8c940-2e5a-4c43-a955-cbae1bf22f87 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:22.820856 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4be8c940-2e5a-4c43-a955-cbae1bf22f87 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:22.827718 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4be8c940-2e5a-4c43-a955-cbae1bf22f87 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:22.828220 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4be8c940-2e5a-4c43-a955-cbae1bf22f87 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:22.828671 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4be8c940-2e5a-4c43-a955-cbae1bf22f87 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:22.829367 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4be8c940-2e5a-4c43-a955-cbae1bf22f87 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:22.829850 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4be8c940-2e5a-4c43-a955-cbae1bf22f87 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:22.830273 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4be8c940-2e5a-4c43-a955-cbae1bf22f87 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:22.999919 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4be8c940-2e5a-4c43-a955-cbae1bf22f87 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:23.009083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4be8c940-2e5a-4c43-a955-cbae1bf22f87 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:23.010808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4be8c940-2e5a-4c43-a955-cbae1bf22f87 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:23.013226 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4be8c940-2e5a-4c43-a955-cbae1bf22f87 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.197399 Aug 04 22:21:23.014198 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 103/196] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:22 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:21:23.229545 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9249b2c4-3499-4bc2-8b39-3b6dd46ca733 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:23.230162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-9249b2c4-3499-4bc2-8b39-3b6dd46ca733 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:23.236154 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9249b2c4-3499-4bc2-8b39-3b6dd46ca733 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:23.236644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9249b2c4-3499-4bc2-8b39-3b6dd46ca733 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:23.237091 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9249b2c4-3499-4bc2-8b39-3b6dd46ca733 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:23.237814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9249b2c4-3499-4bc2-8b39-3b6dd46ca733 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:23.238276 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9249b2c4-3499-4bc2-8b39-3b6dd46ca733 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:23.238700 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9249b2c4-3499-4bc2-8b39-3b6dd46ca733 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:23.367867 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9249b2c4-3499-4bc2-8b39-3b6dd46ca733 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:23.375736 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9249b2c4-3499-4bc2-8b39-3b6dd46ca733 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.149951 Aug 04 22:21:23.376321 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 94/197] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:23 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:23.426049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f05e8f8e-b112-4ebe-8a72-12109738f23d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:23.426652 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f05e8f8e-b112-4ebe-8a72-12109738f23d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:23.432512 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f05e8f8e-b112-4ebe-8a72-12109738f23d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:23.432987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f05e8f8e-b112-4ebe-8a72-12109738f23d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:23.433425 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f05e8f8e-b112-4ebe-8a72-12109738f23d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:23.434183 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f05e8f8e-b112-4ebe-8a72-12109738f23d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:23.435618 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f05e8f8e-b112-4ebe-8a72-12109738f23d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:23.436039 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f05e8f8e-b112-4ebe-8a72-12109738f23d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:23.568345 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f05e8f8e-b112-4ebe-8a72-12109738f23d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:23.576255 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f05e8f8e-b112-4ebe-8a72-12109738f23d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.153981 Aug 04 22:21:23.576829 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 104/198] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:23 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:24.038342 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9d574dc1-bd4b-46c0-9b3b-ec658f24afe9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:24.038781 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-9d574dc1-bd4b-46c0-9b3b-ec658f24afe9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:24.045037 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9d574dc1-bd4b-46c0-9b3b-ec658f24afe9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:24.045719 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9d574dc1-bd4b-46c0-9b3b-ec658f24afe9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:24.046143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9d574dc1-bd4b-46c0-9b3b-ec658f24afe9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:24.046982 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9d574dc1-bd4b-46c0-9b3b-ec658f24afe9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:24.047581 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9d574dc1-bd4b-46c0-9b3b-ec658f24afe9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:24.048146 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9d574dc1-bd4b-46c0-9b3b-ec658f24afe9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:24.183570 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9d574dc1-bd4b-46c0-9b3b-ec658f24afe9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:24.192427 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9d574dc1-bd4b-46c0-9b3b-ec658f24afe9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:24.194012 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9d574dc1-bd4b-46c0-9b3b-ec658f24afe9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:24.195124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9d574dc1-bd4b-46c0-9b3b-ec658f24afe9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.161026 Aug 04 22:21:24.195686 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 95/199] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:24 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:24.396081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d85bec13-1317-4387-98cf-6103a69dffec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:24.396688 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d85bec13-1317-4387-98cf-6103a69dffec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:24.402833 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d85bec13-1317-4387-98cf-6103a69dffec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:24.403329 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d85bec13-1317-4387-98cf-6103a69dffec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:24.403792 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d85bec13-1317-4387-98cf-6103a69dffec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:24.404474 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d85bec13-1317-4387-98cf-6103a69dffec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:24.404919 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d85bec13-1317-4387-98cf-6103a69dffec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:24.405367 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d85bec13-1317-4387-98cf-6103a69dffec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:24.539094 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d85bec13-1317-4387-98cf-6103a69dffec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:24.546721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d85bec13-1317-4387-98cf-6103a69dffec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.154495 Aug 04 22:21:24.547284 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 105/200] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:24 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:24.598120 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1fe2eb6e-9fe2-45ad-9bb6-1da28b5b98e1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:24.598743 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1fe2eb6e-9fe2-45ad-9bb6-1da28b5b98e1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:24.604717 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1fe2eb6e-9fe2-45ad-9bb6-1da28b5b98e1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:24.605197 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1fe2eb6e-9fe2-45ad-9bb6-1da28b5b98e1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:24.605664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1fe2eb6e-9fe2-45ad-9bb6-1da28b5b98e1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:24.606384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1fe2eb6e-9fe2-45ad-9bb6-1da28b5b98e1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:24.606843 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1fe2eb6e-9fe2-45ad-9bb6-1da28b5b98e1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:24.607269 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1fe2eb6e-9fe2-45ad-9bb6-1da28b5b98e1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:24.736648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1fe2eb6e-9fe2-45ad-9bb6-1da28b5b98e1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:24.744266 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1fe2eb6e-9fe2-45ad-9bb6-1da28b5b98e1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.150820 Aug 04 22:21:24.744837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 96/201] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:24 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:25.218291 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-45352694-5812-49f0-826a-3cbe9e9752b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:25.218896 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-45352694-5812-49f0-826a-3cbe9e9752b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:25.225842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45352694-5812-49f0-826a-3cbe9e9752b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:25.226321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45352694-5812-49f0-826a-3cbe9e9752b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:25.226759 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45352694-5812-49f0-826a-3cbe9e9752b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:25.227444 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45352694-5812-49f0-826a-3cbe9e9752b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:25.227894 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45352694-5812-49f0-826a-3cbe9e9752b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:25.228312 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45352694-5812-49f0-826a-3cbe9e9752b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:25.358992 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-45352694-5812-49f0-826a-3cbe9e9752b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:25.367664 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-45352694-5812-49f0-826a-3cbe9e9752b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:25.369180 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-45352694-5812-49f0-826a-3cbe9e9752b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:25.370315 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-45352694-5812-49f0-826a-3cbe9e9752b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.156550 Aug 04 22:21:25.370875 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 106/202] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:25 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:25.569316 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b86d8093-0336-4196-95ec-ac5e72eae187 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:25.569891 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b86d8093-0336-4196-95ec-ac5e72eae187 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:25.575903 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b86d8093-0336-4196-95ec-ac5e72eae187 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:25.576385 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b86d8093-0336-4196-95ec-ac5e72eae187 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:25.576821 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b86d8093-0336-4196-95ec-ac5e72eae187 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:25.577691 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b86d8093-0336-4196-95ec-ac5e72eae187 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:25.578153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b86d8093-0336-4196-95ec-ac5e72eae187 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:25.578582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b86d8093-0336-4196-95ec-ac5e72eae187 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:25.704005 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b86d8093-0336-4196-95ec-ac5e72eae187 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:25.711804 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b86d8093-0336-4196-95ec-ac5e72eae187 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.147202 Aug 04 22:21:25.712371 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 97/203] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:25 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:25.763944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-24f7f4b1-4911-400a-9699-3f378721f7b5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:25.764560 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-24f7f4b1-4911-400a-9699-3f378721f7b5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:25.770688 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-24f7f4b1-4911-400a-9699-3f378721f7b5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:25.771171 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-24f7f4b1-4911-400a-9699-3f378721f7b5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:25.771607 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-24f7f4b1-4911-400a-9699-3f378721f7b5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:25.772295 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-24f7f4b1-4911-400a-9699-3f378721f7b5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:25.772752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-24f7f4b1-4911-400a-9699-3f378721f7b5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:25.773194 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-24f7f4b1-4911-400a-9699-3f378721f7b5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:25.902077 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-24f7f4b1-4911-400a-9699-3f378721f7b5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:25.910101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-24f7f4b1-4911-400a-9699-3f378721f7b5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.150020 Aug 04 22:21:25.910658 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 107/204] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:25 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:26.392040 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d9f29813-28f9-4c14-bf3c-4094db278c7e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:26.392595 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d9f29813-28f9-4c14-bf3c-4094db278c7e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:26.399912 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d9f29813-28f9-4c14-bf3c-4094db278c7e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:26.400394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d9f29813-28f9-4c14-bf3c-4094db278c7e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:26.400826 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d9f29813-28f9-4c14-bf3c-4094db278c7e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:26.401553 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d9f29813-28f9-4c14-bf3c-4094db278c7e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:26.402007 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d9f29813-28f9-4c14-bf3c-4094db278c7e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:26.402439 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d9f29813-28f9-4c14-bf3c-4094db278c7e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:26.535341 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d9f29813-28f9-4c14-bf3c-4094db278c7e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:26.543352 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d9f29813-28f9-4c14-bf3c-4094db278c7e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:26.544858 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d9f29813-28f9-4c14-bf3c-4094db278c7e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:26.545999 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d9f29813-28f9-4c14-bf3c-4094db278c7e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.157912 Aug 04 22:21:26.546557 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 98/205] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:26 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:26.732000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-81a4f686-bf59-4d5f-9d0c-a695e249f99e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:26.732608 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-81a4f686-bf59-4d5f-9d0c-a695e249f99e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:26.738755 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81a4f686-bf59-4d5f-9d0c-a695e249f99e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:26.739241 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81a4f686-bf59-4d5f-9d0c-a695e249f99e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:26.739673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81a4f686-bf59-4d5f-9d0c-a695e249f99e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:26.740389 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81a4f686-bf59-4d5f-9d0c-a695e249f99e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:26.740841 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81a4f686-bf59-4d5f-9d0c-a695e249f99e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:26.741262 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81a4f686-bf59-4d5f-9d0c-a695e249f99e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:26.869309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-81a4f686-bf59-4d5f-9d0c-a695e249f99e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:26.878386 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-81a4f686-bf59-4d5f-9d0c-a695e249f99e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.149195 Aug 04 22:21:26.878986 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 108/206] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:26 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:26.930858 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-fd72e180-af2b-4517-89a7-1648259555ce tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:26.931413 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-fd72e180-af2b-4517-89a7-1648259555ce tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:26.937329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fd72e180-af2b-4517-89a7-1648259555ce tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:26.937848 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fd72e180-af2b-4517-89a7-1648259555ce tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:26.938300 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fd72e180-af2b-4517-89a7-1648259555ce tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:26.938980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fd72e180-af2b-4517-89a7-1648259555ce tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:26.939439 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fd72e180-af2b-4517-89a7-1648259555ce tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:26.940484 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fd72e180-af2b-4517-89a7-1648259555ce tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:27.071732 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-fd72e180-af2b-4517-89a7-1648259555ce tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:27.079035 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-fd72e180-af2b-4517-89a7-1648259555ce tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.152073 Aug 04 22:21:27.079597 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 99/207] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:26 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:27.569377 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-49b02d95-8531-42a6-bc3a-822984ce20d8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:27.570089 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-49b02d95-8531-42a6-bc3a-822984ce20d8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:27.576213 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-49b02d95-8531-42a6-bc3a-822984ce20d8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:27.576542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-49b02d95-8531-42a6-bc3a-822984ce20d8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:27.576982 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-49b02d95-8531-42a6-bc3a-822984ce20d8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:27.577704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-49b02d95-8531-42a6-bc3a-822984ce20d8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:27.578157 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-49b02d95-8531-42a6-bc3a-822984ce20d8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:27.578582 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-49b02d95-8531-42a6-bc3a-822984ce20d8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:27.711120 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-49b02d95-8531-42a6-bc3a-822984ce20d8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:27.719428 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-49b02d95-8531-42a6-bc3a-822984ce20d8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:27.721658 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-49b02d95-8531-42a6-bc3a-822984ce20d8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:27.722856 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-49b02d95-8531-42a6-bc3a-822984ce20d8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.158051 Aug 04 22:21:27.723412 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 109/208] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:27 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:27.899145 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-073cd2a9-d89e-40de-802f-a7997bb20785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:27.899759 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-073cd2a9-d89e-40de-802f-a7997bb20785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:27.905712 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-073cd2a9-d89e-40de-802f-a7997bb20785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:27.906202 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-073cd2a9-d89e-40de-802f-a7997bb20785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:27.906640 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-073cd2a9-d89e-40de-802f-a7997bb20785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:27.907333 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-073cd2a9-d89e-40de-802f-a7997bb20785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:27.907788 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-073cd2a9-d89e-40de-802f-a7997bb20785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:27.909263 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-073cd2a9-d89e-40de-802f-a7997bb20785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:28.041246 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-073cd2a9-d89e-40de-802f-a7997bb20785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:28.049578 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-073cd2a9-d89e-40de-802f-a7997bb20785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.153748 Aug 04 22:21:28.050161 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 100/209] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:27 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:28.099290 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5d234791-62aa-4ad8-856a-33ed5b1ce341 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:28.099906 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5d234791-62aa-4ad8-856a-33ed5b1ce341 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:28.106027 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5d234791-62aa-4ad8-856a-33ed5b1ce341 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:28.106512 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5d234791-62aa-4ad8-856a-33ed5b1ce341 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:28.106944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5d234791-62aa-4ad8-856a-33ed5b1ce341 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:28.107639 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5d234791-62aa-4ad8-856a-33ed5b1ce341 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:28.108137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5d234791-62aa-4ad8-856a-33ed5b1ce341 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:28.108558 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5d234791-62aa-4ad8-856a-33ed5b1ce341 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:28.238338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5d234791-62aa-4ad8-856a-33ed5b1ce341 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:28.249898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5d234791-62aa-4ad8-856a-33ed5b1ce341 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.154870 Aug 04 22:21:28.250497 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 110/210] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:28 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:28.745294 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9b52ccce-5722-4fda-b8c3-9b1ab2c434bc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:28.745932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-9b52ccce-5722-4fda-b8c3-9b1ab2c434bc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:28.752242 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9b52ccce-5722-4fda-b8c3-9b1ab2c434bc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:28.752714 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9b52ccce-5722-4fda-b8c3-9b1ab2c434bc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:28.753230 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9b52ccce-5722-4fda-b8c3-9b1ab2c434bc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:28.753943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9b52ccce-5722-4fda-b8c3-9b1ab2c434bc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:28.754392 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9b52ccce-5722-4fda-b8c3-9b1ab2c434bc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:28.754808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9b52ccce-5722-4fda-b8c3-9b1ab2c434bc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:28.853934 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-5a97d295-fa65-414e-a49a-77c445d664ed req-e7e5d790-7811-4458-80df-fd8eb5567db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33083aef-a898-484c-9060-827392ed18bc", "name": "network-vif-plugged", "status": "completed", "tag": "dce2fd0b-8452-4b56-810e-62ae9cf27a28"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:21:28.864121 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-5a97d295-fa65-414e-a49a-77c445d664ed req-e7e5d790-7811-4458-80df-fd8eb5567db5 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:28.864592 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-5a97d295-fa65-414e-a49a-77c445d664ed req-e7e5d790-7811-4458-80df-fd8eb5567db5 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:28.865009 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-5a97d295-fa65-414e-a49a-77c445d664ed req-e7e5d790-7811-4458-80df-fd8eb5567db5 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:28.877137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-5a97d295-fa65-414e-a49a-77c445d664ed req-e7e5d790-7811-4458-80df-fd8eb5567db5 service nova] Creating event network-vif-plugged:dce2fd0b-8452-4b56-810e-62ae9cf27a28 for instance 33083aef-a898-484c-9060-827392ed18bc on hv-cinder-85221 Aug 04 22:21:28.882970 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-5a97d295-fa65-414e-a49a-77c445d664ed req-e7e5d790-7811-4458-80df-fd8eb5567db5 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032789 Aug 04 22:21:28.883597 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 111/211] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:21:28.899316 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9b52ccce-5722-4fda-b8c3-9b1ab2c434bc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:28.907249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9b52ccce-5722-4fda-b8c3-9b1ab2c434bc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:28.909272 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9b52ccce-5722-4fda-b8c3-9b1ab2c434bc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:28.910454 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9b52ccce-5722-4fda-b8c3-9b1ab2c434bc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.169066 Aug 04 22:21:28.911008 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 101/212] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:28 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:29.070308 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1f07bea8-9944-4a9f-8da5-051c30826c4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:29.070994 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1f07bea8-9944-4a9f-8da5-051c30826c4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:29.077016 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1f07bea8-9944-4a9f-8da5-051c30826c4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:29.077527 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1f07bea8-9944-4a9f-8da5-051c30826c4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:29.077957 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1f07bea8-9944-4a9f-8da5-051c30826c4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:29.078632 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1f07bea8-9944-4a9f-8da5-051c30826c4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:29.079080 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1f07bea8-9944-4a9f-8da5-051c30826c4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:29.079496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1f07bea8-9944-4a9f-8da5-051c30826c4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:29.208352 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1f07bea8-9944-4a9f-8da5-051c30826c4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:29.210719 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:29.217446 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1f07bea8-9944-4a9f-8da5-051c30826c4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.151241 Aug 04 22:21:29.218024 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 112/213] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:29 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:29.271520 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3c237b1d-c070-4dc9-8205-592effd38975 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:29.272134 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3c237b1d-c070-4dc9-8205-592effd38975 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:29.278061 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3c237b1d-c070-4dc9-8205-592effd38975 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:29.278549 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3c237b1d-c070-4dc9-8205-592effd38975 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:29.278984 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3c237b1d-c070-4dc9-8205-592effd38975 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:29.279676 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3c237b1d-c070-4dc9-8205-592effd38975 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:29.280128 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3c237b1d-c070-4dc9-8205-592effd38975 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:29.280551 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3c237b1d-c070-4dc9-8205-592effd38975 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:29.423418 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3c237b1d-c070-4dc9-8205-592effd38975 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:29.431078 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3c237b1d-c070-4dc9-8205-592effd38975 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.163923 Aug 04 22:21:29.431650 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 102/214] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:29 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:29.746931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e2f74794-29d0-4556-810e-14d68a249ebb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aeec278b-99d2-4b0c-8936-52f79eb8ad9b"}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:21:29.749558 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e2f74794-29d0-4556-810e-14d68a249ebb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:29.756236 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e2f74794-29d0-4556-810e-14d68a249ebb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:29.756717 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e2f74794-29d0-4556-810e-14d68a249ebb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:29.757150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e2f74794-29d0-4556-810e-14d68a249ebb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:29.757867 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e2f74794-29d0-4556-810e-14d68a249ebb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:29.758322 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e2f74794-29d0-4556-810e-14d68a249ebb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:29.758744 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e2f74794-29d0-4556-810e-14d68a249ebb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:29.934319 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4b5aa23d-af31-44ac-b7be-54546008db2e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:29.934872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4b5aa23d-af31-44ac-b7be-54546008db2e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:29.942509 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5aa23d-af31-44ac-b7be-54546008db2e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:29.942999 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5aa23d-af31-44ac-b7be-54546008db2e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:29.943438 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5aa23d-af31-44ac-b7be-54546008db2e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:29.944136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5aa23d-af31-44ac-b7be-54546008db2e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:29.944595 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5aa23d-af31-44ac-b7be-54546008db2e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:29.945046 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5aa23d-af31-44ac-b7be-54546008db2e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:30.076152 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4b5aa23d-af31-44ac-b7be-54546008db2e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:30.084035 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4b5aa23d-af31-44ac-b7be-54546008db2e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:30.085619 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4b5aa23d-af31-44ac-b7be-54546008db2e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:30.086719 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4b5aa23d-af31-44ac-b7be-54546008db2e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.156722 Aug 04 22:21:30.087506 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 103/215] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:29 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:21:30.239196 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-952019c6-d52c-4592-aeb2-60cf79c9c501 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:30.239740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-952019c6-d52c-4592-aeb2-60cf79c9c501 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:30.245626 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-952019c6-d52c-4592-aeb2-60cf79c9c501 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:30.246143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-952019c6-d52c-4592-aeb2-60cf79c9c501 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:30.246538 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-952019c6-d52c-4592-aeb2-60cf79c9c501 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:30.247483 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-952019c6-d52c-4592-aeb2-60cf79c9c501 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:30.248348 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-952019c6-d52c-4592-aeb2-60cf79c9c501 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:30.248907 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-952019c6-d52c-4592-aeb2-60cf79c9c501 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:30.393138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-952019c6-d52c-4592-aeb2-60cf79c9c501 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:30.403757 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-952019c6-d52c-4592-aeb2-60cf79c9c501 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.169254 Aug 04 22:21:30.404329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 104/216] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:30 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:30.452033 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0a0f81a5-717b-4902-af28-f65dca554c3a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:30.452684 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0a0f81a5-717b-4902-af28-f65dca554c3a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:30.459806 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a0f81a5-717b-4902-af28-f65dca554c3a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:30.460298 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a0f81a5-717b-4902-af28-f65dca554c3a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:30.460912 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a0f81a5-717b-4902-af28-f65dca554c3a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:30.461645 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a0f81a5-717b-4902-af28-f65dca554c3a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:30.462269 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a0f81a5-717b-4902-af28-f65dca554c3a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:30.462694 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a0f81a5-717b-4902-af28-f65dca554c3a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:30.599680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0a0f81a5-717b-4902-af28-f65dca554c3a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:30.607388 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0a0f81a5-717b-4902-af28-f65dca554c3a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.159165 Aug 04 22:21:30.607993 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 105/217] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:30 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:31.108828 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-11474954-67ae-4a13-80b4-1ec9cc1524f9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:31.109714 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-11474954-67ae-4a13-80b4-1ec9cc1524f9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:31.116978 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-11474954-67ae-4a13-80b4-1ec9cc1524f9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:31.117508 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-11474954-67ae-4a13-80b4-1ec9cc1524f9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:31.117950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-11474954-67ae-4a13-80b4-1ec9cc1524f9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:31.118657 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-11474954-67ae-4a13-80b4-1ec9cc1524f9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:31.119113 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-11474954-67ae-4a13-80b4-1ec9cc1524f9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:31.119858 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-11474954-67ae-4a13-80b4-1ec9cc1524f9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:31.148537 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e2f74794-29d0-4556-810e-14d68a249ebb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "POST /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.405450 Aug 04 22:21:31.149231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 113/218] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:21:29 2022] POST /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09/os-volume_attachments => generated 194 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:21:31.255194 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-11474954-67ae-4a13-80b4-1ec9cc1524f9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:31.263284 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-11474954-67ae-4a13-80b4-1ec9cc1524f9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:31.264784 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-11474954-67ae-4a13-80b4-1ec9cc1524f9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:31.265913 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-11474954-67ae-4a13-80b4-1ec9cc1524f9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1411 microversion: 2.20 time: 0.161113 Aug 04 22:21:31.266481 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 106/219] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:31 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1411 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:21:31.431088 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-12a80d3a-b9bc-4edf-b4ef-bdc7a65bcd35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:31.431873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-12a80d3a-b9bc-4edf-b4ef-bdc7a65bcd35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:31.438773 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-12a80d3a-b9bc-4edf-b4ef-bdc7a65bcd35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:31.439352 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-12a80d3a-b9bc-4edf-b4ef-bdc7a65bcd35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:31.440813 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-12a80d3a-b9bc-4edf-b4ef-bdc7a65bcd35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:31.445224 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-12a80d3a-b9bc-4edf-b4ef-bdc7a65bcd35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:31.446209 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-12a80d3a-b9bc-4edf-b4ef-bdc7a65bcd35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:31.447021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-12a80d3a-b9bc-4edf-b4ef-bdc7a65bcd35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:31.626702 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-12a80d3a-b9bc-4edf-b4ef-bdc7a65bcd35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:31.632310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-af46885c-4f4a-4a0d-87a5-6407c7f500c6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:31.633251 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-af46885c-4f4a-4a0d-87a5-6407c7f500c6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:31.636329 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-12a80d3a-b9bc-4edf-b4ef-bdc7a65bcd35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.214242 Aug 04 22:21:31.637253 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 114/220] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:31 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:31.656641 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-af46885c-4f4a-4a0d-87a5-6407c7f500c6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:31.657136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-af46885c-4f4a-4a0d-87a5-6407c7f500c6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:31.657931 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-af46885c-4f4a-4a0d-87a5-6407c7f500c6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:31.658810 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-af46885c-4f4a-4a0d-87a5-6407c7f500c6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:31.659125 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-af46885c-4f4a-4a0d-87a5-6407c7f500c6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:31.659541 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-af46885c-4f4a-4a0d-87a5-6407c7f500c6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:32.037295 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-af46885c-4f4a-4a0d-87a5-6407c7f500c6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:32.045335 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-af46885c-4f4a-4a0d-87a5-6407c7f500c6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.418764 Aug 04 22:21:32.045947 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 107/221] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:31 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:32.288695 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-99e5755c-a9ec-4003-9d94-2f04605cf759 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:32.289312 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-99e5755c-a9ec-4003-9d94-2f04605cf759 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:32.300754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-99e5755c-a9ec-4003-9d94-2f04605cf759 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:32.301361 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-99e5755c-a9ec-4003-9d94-2f04605cf759 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:32.301824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-99e5755c-a9ec-4003-9d94-2f04605cf759 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:32.302533 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-99e5755c-a9ec-4003-9d94-2f04605cf759 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:32.302987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-99e5755c-a9ec-4003-9d94-2f04605cf759 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:32.303587 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-99e5755c-a9ec-4003-9d94-2f04605cf759 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:32.507437 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-99e5755c-a9ec-4003-9d94-2f04605cf759 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:32.517962 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-99e5755c-a9ec-4003-9d94-2f04605cf759 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:32.520112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-99e5755c-a9ec-4003-9d94-2f04605cf759 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:32.521726 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-99e5755c-a9ec-4003-9d94-2f04605cf759 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1604 microversion: 2.20 time: 0.236673 Aug 04 22:21:32.522286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 115/222] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:21:32 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1604 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:21:32.550783 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-50cad542-f669-40f6-bdcf-47c865fbda27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:32.551337 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-50cad542-f669-40f6-bdcf-47c865fbda27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:32.569617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50cad542-f669-40f6-bdcf-47c865fbda27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:32.570183 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50cad542-f669-40f6-bdcf-47c865fbda27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:32.570618 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50cad542-f669-40f6-bdcf-47c865fbda27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:32.571204 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50cad542-f669-40f6-bdcf-47c865fbda27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:32.572005 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50cad542-f669-40f6-bdcf-47c865fbda27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:32.572518 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50cad542-f669-40f6-bdcf-47c865fbda27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:32.606274 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=100 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:32.661434 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0a5d3fa6-6942-42df-9808-77d61953504d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:32.666469 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0a5d3fa6-6942-42df-9808-77d61953504d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:32.694609 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0a5d3fa6-6942-42df-9808-77d61953504d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:32.695496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0a5d3fa6-6942-42df-9808-77d61953504d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:32.697095 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0a5d3fa6-6942-42df-9808-77d61953504d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:32.698043 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0a5d3fa6-6942-42df-9808-77d61953504d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:32.709936 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0a5d3fa6-6942-42df-9808-77d61953504d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:32.710533 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0a5d3fa6-6942-42df-9808-77d61953504d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:32.723415 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-50cad542-f669-40f6-bdcf-47c865fbda27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.180114 Aug 04 22:21:32.724605 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 108/223] 10.222.0.109 () {60 vars in 1321 bytes} [Thu Aug 4 22:21:32 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:21:32.909256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-2c39a2cc-cdb8-4fd3-83fe-0cc03ca01a4e req-51a219b2-2576-489d-b4d7-1c75166a0465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6318eb70-fdcf-4545-b737-61e032221d53", "name": "network-vif-plugged", "status": "completed", "tag": "39cb006e-1fc6-41fe-8b9f-b8a5c87f0721"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:21:32.927043 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-2c39a2cc-cdb8-4fd3-83fe-0cc03ca01a4e req-51a219b2-2576-489d-b4d7-1c75166a0465 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:32.930114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-2c39a2cc-cdb8-4fd3-83fe-0cc03ca01a4e req-51a219b2-2576-489d-b4d7-1c75166a0465 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:32.931426 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-2c39a2cc-cdb8-4fd3-83fe-0cc03ca01a4e req-51a219b2-2576-489d-b4d7-1c75166a0465 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:32.955937 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-2c39a2cc-cdb8-4fd3-83fe-0cc03ca01a4e req-51a219b2-2576-489d-b4d7-1c75166a0465 service nova] Creating event network-vif-plugged:39cb006e-1fc6-41fe-8b9f-b8a5c87f0721 for instance 6318eb70-fdcf-4545-b737-61e032221d53 on hv-cinder-85221 Aug 04 22:21:32.962135 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-2c39a2cc-cdb8-4fd3-83fe-0cc03ca01a4e req-51a219b2-2576-489d-b4d7-1c75166a0465 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059896 Aug 04 22:21:32.963123 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 109/224] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:21:33.068488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-94b71a5a-7772-409c-b94c-3a819c5640aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:33.069193 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-94b71a5a-7772-409c-b94c-3a819c5640aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:33.084008 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-94b71a5a-7772-409c-b94c-3a819c5640aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:33.084518 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-94b71a5a-7772-409c-b94c-3a819c5640aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:33.084956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-94b71a5a-7772-409c-b94c-3a819c5640aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:33.085712 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-94b71a5a-7772-409c-b94c-3a819c5640aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:33.086168 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-94b71a5a-7772-409c-b94c-3a819c5640aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:33.086593 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-94b71a5a-7772-409c-b94c-3a819c5640aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:33.139835 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0a5d3fa6-6942-42df-9808-77d61953504d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:33.150700 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0a5d3fa6-6942-42df-9808-77d61953504d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1326 microversion: 2.1 time: 0.494089 Aug 04 22:21:33.164822 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 116/225] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:32 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1326 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:33.363247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-94b71a5a-7772-409c-b94c-3a819c5640aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:33.378429 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-94b71a5a-7772-409c-b94c-3a819c5640aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.314578 Aug 04 22:21:33.380059 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 110/226] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:33 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:34.172966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5df11598-0ab0-486b-90f8-7e681af3b816 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:34.174181 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5df11598-0ab0-486b-90f8-7e681af3b816 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:34.186112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5df11598-0ab0-486b-90f8-7e681af3b816 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:34.190099 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5df11598-0ab0-486b-90f8-7e681af3b816 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:34.190807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5df11598-0ab0-486b-90f8-7e681af3b816 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:34.192385 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5df11598-0ab0-486b-90f8-7e681af3b816 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:34.194936 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5df11598-0ab0-486b-90f8-7e681af3b816 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:34.195609 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5df11598-0ab0-486b-90f8-7e681af3b816 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:34.399645 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-cbd109d0-a478-4af7-b26d-a9b2933c374f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:34.400208 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-cbd109d0-a478-4af7-b26d-a9b2933c374f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:34.408720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbd109d0-a478-4af7-b26d-a9b2933c374f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:34.409096 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbd109d0-a478-4af7-b26d-a9b2933c374f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:34.409556 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbd109d0-a478-4af7-b26d-a9b2933c374f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:34.415931 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbd109d0-a478-4af7-b26d-a9b2933c374f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:34.416726 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbd109d0-a478-4af7-b26d-a9b2933c374f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:34.417216 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbd109d0-a478-4af7-b26d-a9b2933c374f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:34.490631 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5df11598-0ab0-486b-90f8-7e681af3b816 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:34.502596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5df11598-0ab0-486b-90f8-7e681af3b816 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1520 microversion: 2.1 time: 0.330828 Aug 04 22:21:34.502596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 117/227] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:34 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1520 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:34.525777 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f3cf121e-bbad-4ded-bb10-45d8a1908a3a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:21:34.529577 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f3cf121e-bbad-4ded-bb10-45d8a1908a3a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:34.536752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f3cf121e-bbad-4ded-bb10-45d8a1908a3a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:34.537501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f3cf121e-bbad-4ded-bb10-45d8a1908a3a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:34.537978 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f3cf121e-bbad-4ded-bb10-45d8a1908a3a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:34.538851 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f3cf121e-bbad-4ded-bb10-45d8a1908a3a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:34.539408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f3cf121e-bbad-4ded-bb10-45d8a1908a3a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:34.539926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f3cf121e-bbad-4ded-bb10-45d8a1908a3a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:34.569347 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-f3cf121e-bbad-4ded-bb10-45d8a1908a3a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lazy-loading 'flavor' on Instance uuid 33083aef-a898-484c-9060-827392ed18bc {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:21:34.811764 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f3cf121e-bbad-4ded-bb10-45d8a1908a3a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "POST /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc/action" status: 200 len: 32 microversion: 2.1 time: 0.291616 Aug 04 22:21:34.812625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 118/228] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:21:34 2022] POST /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc/action => generated 32 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 22:21:34.824403 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ce13c150-2f94-4106-a63a-f742ddfe35d4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:34.825879 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ce13c150-2f94-4106-a63a-f742ddfe35d4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:34.837331 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce13c150-2f94-4106-a63a-f742ddfe35d4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:34.838447 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce13c150-2f94-4106-a63a-f742ddfe35d4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:34.839456 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce13c150-2f94-4106-a63a-f742ddfe35d4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:34.842810 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce13c150-2f94-4106-a63a-f742ddfe35d4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:34.845035 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce13c150-2f94-4106-a63a-f742ddfe35d4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:34.845862 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce13c150-2f94-4106-a63a-f742ddfe35d4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:35.044487 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-cbd109d0-a478-4af7-b26d-a9b2933c374f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:35.052335 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-cbd109d0-a478-4af7-b26d-a9b2933c374f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.656747 Aug 04 22:21:35.052952 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 111/229] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:34 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:35.276562 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-3429fe14-0e14-480a-95e3-ab5e39bbca79 req-ae0e8bf1-fc65-4722-9fe9-60c09ed86353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb440660-4715-48f6-a7ff-f0b74dfefe21", "tag": "417dd402-4a58-49ce-a237-c5d14b0ce44d"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:21:35.294808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-3429fe14-0e14-480a-95e3-ab5e39bbca79 req-ae0e8bf1-fc65-4722-9fe9-60c09ed86353 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:35.295298 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-3429fe14-0e14-480a-95e3-ab5e39bbca79 req-ae0e8bf1-fc65-4722-9fe9-60c09ed86353 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:35.295908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-ce13c150-2f94-4106-a63a-f742ddfe35d4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:35.297073 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-3429fe14-0e14-480a-95e3-ab5e39bbca79 req-ae0e8bf1-fc65-4722-9fe9-60c09ed86353 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:35.316380 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ce13c150-2f94-4106-a63a-f742ddfe35d4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.493685 Aug 04 22:21:35.319936 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 119/230] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:34 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:35.326661 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-3429fe14-0e14-480a-95e3-ab5e39bbca79 req-ae0e8bf1-fc65-4722-9fe9-60c09ed86353 service nova] Creating event network-changed:417dd402-4a58-49ce-a237-c5d14b0ce44d for instance eb440660-4715-48f6-a7ff-f0b74dfefe21 on hv-cinder-85221 Aug 04 22:21:35.340237 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-3429fe14-0e14-480a-95e3-ab5e39bbca79 req-ae0e8bf1-fc65-4722-9fe9-60c09ed86353 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069988 Aug 04 22:21:35.342058 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 112/231] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:21:36.083074 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-830b779b-6202-4da0-99c3-5dffbd0d526d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:36.085760 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-830b779b-6202-4da0-99c3-5dffbd0d526d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:36.099403 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-830b779b-6202-4da0-99c3-5dffbd0d526d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:36.099403 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-830b779b-6202-4da0-99c3-5dffbd0d526d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:36.099403 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-830b779b-6202-4da0-99c3-5dffbd0d526d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:36.099403 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-830b779b-6202-4da0-99c3-5dffbd0d526d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:36.099700 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-830b779b-6202-4da0-99c3-5dffbd0d526d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:36.099700 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-830b779b-6202-4da0-99c3-5dffbd0d526d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:36.346160 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-62f8cecf-b1c3-489d-9f70-29fbc4d31b53 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:36.346911 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-62f8cecf-b1c3-489d-9f70-29fbc4d31b53 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:36.358841 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62f8cecf-b1c3-489d-9f70-29fbc4d31b53 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:36.359332 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62f8cecf-b1c3-489d-9f70-29fbc4d31b53 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:36.359779 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62f8cecf-b1c3-489d-9f70-29fbc4d31b53 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:36.360463 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62f8cecf-b1c3-489d-9f70-29fbc4d31b53 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:36.368088 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62f8cecf-b1c3-489d-9f70-29fbc4d31b53 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:36.368681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62f8cecf-b1c3-489d-9f70-29fbc4d31b53 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:36.413442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-830b779b-6202-4da0-99c3-5dffbd0d526d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:36.423049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-830b779b-6202-4da0-99c3-5dffbd0d526d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.346998 Aug 04 22:21:36.438195 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 120/232] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:36 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:36.686318 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-62f8cecf-b1c3-489d-9f70-29fbc4d31b53 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:36.696176 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-62f8cecf-b1c3-489d-9f70-29fbc4d31b53 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.356023 Aug 04 22:21:36.697305 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 113/233] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:36 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:37.448472 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d2f7a1d7-5721-4223-95c1-eefad9f123e5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:37.450742 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d2f7a1d7-5721-4223-95c1-eefad9f123e5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:37.462681 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d2f7a1d7-5721-4223-95c1-eefad9f123e5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:37.464202 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d2f7a1d7-5721-4223-95c1-eefad9f123e5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:37.466033 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d2f7a1d7-5721-4223-95c1-eefad9f123e5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:37.467314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d2f7a1d7-5721-4223-95c1-eefad9f123e5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:37.468408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d2f7a1d7-5721-4223-95c1-eefad9f123e5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:37.469094 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d2f7a1d7-5721-4223-95c1-eefad9f123e5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:37.723960 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-8f4d97ff-b8db-4faa-a30c-13818189afcd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:37.724576 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-8f4d97ff-b8db-4faa-a30c-13818189afcd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:37.734699 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8f4d97ff-b8db-4faa-a30c-13818189afcd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:37.735243 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8f4d97ff-b8db-4faa-a30c-13818189afcd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:37.736613 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8f4d97ff-b8db-4faa-a30c-13818189afcd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:37.737671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8f4d97ff-b8db-4faa-a30c-13818189afcd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:37.738287 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8f4d97ff-b8db-4faa-a30c-13818189afcd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:37.738971 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8f4d97ff-b8db-4faa-a30c-13818189afcd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:37.768634 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d2f7a1d7-5721-4223-95c1-eefad9f123e5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:37.777513 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d2f7a1d7-5721-4223-95c1-eefad9f123e5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.335391 Aug 04 22:21:37.778096 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 121/234] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:37 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:37.950009 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8f4d97ff-b8db-4faa-a30c-13818189afcd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:37.968876 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-8f4d97ff-b8db-4faa-a30c-13818189afcd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.250478 Aug 04 22:21:37.972439 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 114/235] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:37 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:38.804328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1e7188b2-93ff-4800-99c7-688498b0ec4d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:38.805727 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1e7188b2-93ff-4800-99c7-688498b0ec4d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:38.812382 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1e7188b2-93ff-4800-99c7-688498b0ec4d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:38.812872 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1e7188b2-93ff-4800-99c7-688498b0ec4d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:38.813310 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1e7188b2-93ff-4800-99c7-688498b0ec4d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:38.814080 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1e7188b2-93ff-4800-99c7-688498b0ec4d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:38.814526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1e7188b2-93ff-4800-99c7-688498b0ec4d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:38.815164 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1e7188b2-93ff-4800-99c7-688498b0ec4d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:38.969278 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1e7188b2-93ff-4800-99c7-688498b0ec4d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:38.978152 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1e7188b2-93ff-4800-99c7-688498b0ec4d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.177576 Aug 04 22:21:38.978659 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 122/236] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:38 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:39.018873 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4b5a963e-ce7f-427d-b43c-70227552f9c9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:39.019485 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4b5a963e-ce7f-427d-b43c-70227552f9c9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:39.025566 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5a963e-ce7f-427d-b43c-70227552f9c9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:39.026052 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5a963e-ce7f-427d-b43c-70227552f9c9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:39.026478 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5a963e-ce7f-427d-b43c-70227552f9c9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:39.027423 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5a963e-ce7f-427d-b43c-70227552f9c9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:39.027942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5a963e-ce7f-427d-b43c-70227552f9c9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:39.028425 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5a963e-ce7f-427d-b43c-70227552f9c9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:39.177713 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4b5a963e-ce7f-427d-b43c-70227552f9c9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:39.185517 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4b5a963e-ce7f-427d-b43c-70227552f9c9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.171051 Aug 04 22:21:39.186296 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 115/237] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:39 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:40.001395 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6ef3f1e9-3391-4e92-8060-77f7beb6a5d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:40.002950 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6ef3f1e9-3391-4e92-8060-77f7beb6a5d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:40.011330 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ef3f1e9-3391-4e92-8060-77f7beb6a5d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:40.011814 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ef3f1e9-3391-4e92-8060-77f7beb6a5d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:40.012247 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ef3f1e9-3391-4e92-8060-77f7beb6a5d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:40.013323 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ef3f1e9-3391-4e92-8060-77f7beb6a5d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:40.013817 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ef3f1e9-3391-4e92-8060-77f7beb6a5d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:40.014367 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ef3f1e9-3391-4e92-8060-77f7beb6a5d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:40.213463 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4b60f6aa-cd7c-4646-b313-e25a230c9ce0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:40.213463 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4b60f6aa-cd7c-4646-b313-e25a230c9ce0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:40.218742 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6ef3f1e9-3391-4e92-8060-77f7beb6a5d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:40.222619 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b60f6aa-cd7c-4646-b313-e25a230c9ce0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:40.223111 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b60f6aa-cd7c-4646-b313-e25a230c9ce0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:40.225831 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b60f6aa-cd7c-4646-b313-e25a230c9ce0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:40.228016 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b60f6aa-cd7c-4646-b313-e25a230c9ce0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:40.228561 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6ef3f1e9-3391-4e92-8060-77f7beb6a5d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.234288 Aug 04 22:21:40.229195 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 123/238] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:39 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:40.229928 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b60f6aa-cd7c-4646-b313-e25a230c9ce0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:40.230442 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b60f6aa-cd7c-4646-b313-e25a230c9ce0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:40.421689 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4b60f6aa-cd7c-4646-b313-e25a230c9ce0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:40.442238 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4b60f6aa-cd7c-4646-b313-e25a230c9ce0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.236047 Aug 04 22:21:40.444240 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 116/239] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:40 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:41.253066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ab35107e-8fcc-4b6e-951c-afe84e66e3f0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:41.254501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ab35107e-8fcc-4b6e-951c-afe84e66e3f0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:41.261431 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab35107e-8fcc-4b6e-951c-afe84e66e3f0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:41.261945 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab35107e-8fcc-4b6e-951c-afe84e66e3f0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:41.262536 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab35107e-8fcc-4b6e-951c-afe84e66e3f0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:41.263402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab35107e-8fcc-4b6e-951c-afe84e66e3f0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:41.263965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab35107e-8fcc-4b6e-951c-afe84e66e3f0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:41.264261 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab35107e-8fcc-4b6e-951c-afe84e66e3f0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:41.441531 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-ab35107e-8fcc-4b6e-951c-afe84e66e3f0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:41.448843 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ab35107e-8fcc-4b6e-951c-afe84e66e3f0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.202703 Aug 04 22:21:41.449595 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 124/240] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:41 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:41.464822 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ff5e7a9d-2f86-48b5-bca8-caa842d5f219 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:41.466134 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ff5e7a9d-2f86-48b5-bca8-caa842d5f219 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:41.474148 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ff5e7a9d-2f86-48b5-bca8-caa842d5f219 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:41.474755 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ff5e7a9d-2f86-48b5-bca8-caa842d5f219 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:41.475306 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ff5e7a9d-2f86-48b5-bca8-caa842d5f219 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:41.476095 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ff5e7a9d-2f86-48b5-bca8-caa842d5f219 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:41.476673 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ff5e7a9d-2f86-48b5-bca8-caa842d5f219 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:41.477220 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ff5e7a9d-2f86-48b5-bca8-caa842d5f219 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:41.733619 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ff5e7a9d-2f86-48b5-bca8-caa842d5f219 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:41.743874 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ff5e7a9d-2f86-48b5-bca8-caa842d5f219 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.283490 Aug 04 22:21:41.744779 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 117/241] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:41 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:42.481064 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a29e7502-8c5f-4033-a33a-7a435b07a397 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:42.483191 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a29e7502-8c5f-4033-a33a-7a435b07a397 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:42.507363 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a29e7502-8c5f-4033-a33a-7a435b07a397 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:42.511792 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a29e7502-8c5f-4033-a33a-7a435b07a397 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:42.512568 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a29e7502-8c5f-4033-a33a-7a435b07a397 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:42.513539 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a29e7502-8c5f-4033-a33a-7a435b07a397 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:42.514954 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a29e7502-8c5f-4033-a33a-7a435b07a397 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:42.516050 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a29e7502-8c5f-4033-a33a-7a435b07a397 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:42.721138 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a29e7502-8c5f-4033-a33a-7a435b07a397 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:42.731427 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a29e7502-8c5f-4033-a33a-7a435b07a397 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.253079 Aug 04 22:21:42.735279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 125/242] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:42 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:42.773028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-fc352c9a-807c-4cbd-aafa-72c8e20aca4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:42.773744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-fc352c9a-807c-4cbd-aafa-72c8e20aca4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:42.776103 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=82 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:42.787681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc352c9a-807c-4cbd-aafa-72c8e20aca4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:42.788432 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc352c9a-807c-4cbd-aafa-72c8e20aca4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:42.789261 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc352c9a-807c-4cbd-aafa-72c8e20aca4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:42.790379 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc352c9a-807c-4cbd-aafa-72c8e20aca4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:42.791083 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc352c9a-807c-4cbd-aafa-72c8e20aca4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:42.791754 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc352c9a-807c-4cbd-aafa-72c8e20aca4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:42.985429 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-fc352c9a-807c-4cbd-aafa-72c8e20aca4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:42.994367 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-fc352c9a-807c-4cbd-aafa-72c8e20aca4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.225930 Aug 04 22:21:42.995591 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 118/243] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:42 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:43.752375 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f2cdbe6c-4320-4b37-a369-5373f0243035 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:43.752995 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f2cdbe6c-4320-4b37-a369-5373f0243035 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:43.759478 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f2cdbe6c-4320-4b37-a369-5373f0243035 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:43.759941 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f2cdbe6c-4320-4b37-a369-5373f0243035 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:43.760377 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f2cdbe6c-4320-4b37-a369-5373f0243035 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:43.761067 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f2cdbe6c-4320-4b37-a369-5373f0243035 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:43.761547 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f2cdbe6c-4320-4b37-a369-5373f0243035 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:43.761974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f2cdbe6c-4320-4b37-a369-5373f0243035 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:43.780678 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:43.904147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f2cdbe6c-4320-4b37-a369-5373f0243035 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:43.911951 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f2cdbe6c-4320-4b37-a369-5373f0243035 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.163467 Aug 04 22:21:43.912514 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 126/244] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:43 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:44.019028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-97fd05c9-b496-4fe2-9fa6-3027388f36b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:44.020184 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-97fd05c9-b496-4fe2-9fa6-3027388f36b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:44.026633 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-97fd05c9-b496-4fe2-9fa6-3027388f36b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:44.027044 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-97fd05c9-b496-4fe2-9fa6-3027388f36b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:44.027483 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-97fd05c9-b496-4fe2-9fa6-3027388f36b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:44.028177 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-97fd05c9-b496-4fe2-9fa6-3027388f36b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:44.028631 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-97fd05c9-b496-4fe2-9fa6-3027388f36b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:44.029053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-97fd05c9-b496-4fe2-9fa6-3027388f36b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:44.377747 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-97fd05c9-b496-4fe2-9fa6-3027388f36b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:44.385389 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-97fd05c9-b496-4fe2-9fa6-3027388f36b4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.371421 Aug 04 22:21:44.386048 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 119/245] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:44 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:44.932558 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-57ef37b8-a707-440e-b006-83493c2aab1c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:44.933095 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-57ef37b8-a707-440e-b006-83493c2aab1c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:44.939679 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57ef37b8-a707-440e-b006-83493c2aab1c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:44.940159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57ef37b8-a707-440e-b006-83493c2aab1c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:44.940607 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57ef37b8-a707-440e-b006-83493c2aab1c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:44.941283 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57ef37b8-a707-440e-b006-83493c2aab1c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:44.941778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57ef37b8-a707-440e-b006-83493c2aab1c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:44.942205 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57ef37b8-a707-440e-b006-83493c2aab1c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:45.066767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-57ef37b8-a707-440e-b006-83493c2aab1c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:45.074128 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-57ef37b8-a707-440e-b006-83493c2aab1c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.145550 Aug 04 22:21:45.074700 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 127/246] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:44 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:45.406583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e42cd736-8460-41ad-856e-a3bbb507a991 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:45.407743 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e42cd736-8460-41ad-856e-a3bbb507a991 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:45.413640 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e42cd736-8460-41ad-856e-a3bbb507a991 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:45.414133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e42cd736-8460-41ad-856e-a3bbb507a991 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:45.414571 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e42cd736-8460-41ad-856e-a3bbb507a991 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:45.415263 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e42cd736-8460-41ad-856e-a3bbb507a991 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:45.415719 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e42cd736-8460-41ad-856e-a3bbb507a991 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:45.416143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e42cd736-8460-41ad-856e-a3bbb507a991 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:45.545303 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e42cd736-8460-41ad-856e-a3bbb507a991 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:45.553878 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e42cd736-8460-41ad-856e-a3bbb507a991 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.151022 Aug 04 22:21:45.554460 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 120/247] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:45 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:46.095139 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f8665622-a3e3-4f02-bf40-2dae39866078 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:46.095752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f8665622-a3e3-4f02-bf40-2dae39866078 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:46.102261 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8665622-a3e3-4f02-bf40-2dae39866078 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:46.102750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8665622-a3e3-4f02-bf40-2dae39866078 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:46.103188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8665622-a3e3-4f02-bf40-2dae39866078 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:46.103888 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8665622-a3e3-4f02-bf40-2dae39866078 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:46.104345 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8665622-a3e3-4f02-bf40-2dae39866078 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:46.104769 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8665622-a3e3-4f02-bf40-2dae39866078 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:46.236595 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f8665622-a3e3-4f02-bf40-2dae39866078 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:46.244112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f8665622-a3e3-4f02-bf40-2dae39866078 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.153336 Aug 04 22:21:46.244720 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 128/248] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:46 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:46.574120 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0c7e6169-3e0f-48de-8e80-291e50a5875b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:46.574925 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0c7e6169-3e0f-48de-8e80-291e50a5875b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:46.582273 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0c7e6169-3e0f-48de-8e80-291e50a5875b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:46.582870 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0c7e6169-3e0f-48de-8e80-291e50a5875b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:46.583415 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0c7e6169-3e0f-48de-8e80-291e50a5875b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:46.584392 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0c7e6169-3e0f-48de-8e80-291e50a5875b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:46.586359 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0c7e6169-3e0f-48de-8e80-291e50a5875b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:46.586922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0c7e6169-3e0f-48de-8e80-291e50a5875b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:46.718493 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0c7e6169-3e0f-48de-8e80-291e50a5875b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:46.727101 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0c7e6169-3e0f-48de-8e80-291e50a5875b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.156776 Aug 04 22:21:46.727743 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 121/249] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:46 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:47.265246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-fc423f29-8317-4dbf-bbfb-81f8a4015ce3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:47.265890 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-fc423f29-8317-4dbf-bbfb-81f8a4015ce3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:47.273218 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fc423f29-8317-4dbf-bbfb-81f8a4015ce3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:47.273786 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fc423f29-8317-4dbf-bbfb-81f8a4015ce3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:47.274219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fc423f29-8317-4dbf-bbfb-81f8a4015ce3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:47.274961 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fc423f29-8317-4dbf-bbfb-81f8a4015ce3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:47.275497 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fc423f29-8317-4dbf-bbfb-81f8a4015ce3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:47.275924 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fc423f29-8317-4dbf-bbfb-81f8a4015ce3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:47.546970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-8ed90f19-4e68-403d-a132-6c0ac982fd7a req-1797ba18-8222-4b1e-96d0-07435c3b800c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9533fa0-d1ed-4df8-9a1f-d754b79c5394", "name": "network-vif-plugged", "status": "completed", "tag": "fd292742-5a95-4c85-9714-6d6e9bd7487f"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:21:47.560723 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-8ed90f19-4e68-403d-a132-6c0ac982fd7a req-1797ba18-8222-4b1e-96d0-07435c3b800c service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:47.569830 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-8ed90f19-4e68-403d-a132-6c0ac982fd7a req-1797ba18-8222-4b1e-96d0-07435c3b800c service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:47.570274 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-8ed90f19-4e68-403d-a132-6c0ac982fd7a req-1797ba18-8222-4b1e-96d0-07435c3b800c service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:47.584889 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-8ed90f19-4e68-403d-a132-6c0ac982fd7a req-1797ba18-8222-4b1e-96d0-07435c3b800c service nova] Creating event network-vif-plugged:fd292742-5a95-4c85-9714-6d6e9bd7487f for instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 on hv-cinder-85221 Aug 04 22:21:47.590865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-8ed90f19-4e68-403d-a132-6c0ac982fd7a req-1797ba18-8222-4b1e-96d0-07435c3b800c service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047571 Aug 04 22:21:47.592305 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 122/250] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:21:47.661884 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-fc423f29-8317-4dbf-bbfb-81f8a4015ce3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:47.672783 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-fc423f29-8317-4dbf-bbfb-81f8a4015ce3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.411157 Aug 04 22:21:47.673612 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 129/251] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:47 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:47.748655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-96d8d104-03bb-4a19-83fd-4e6b413134ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:47.749352 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-96d8d104-03bb-4a19-83fd-4e6b413134ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:47.756611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-96d8d104-03bb-4a19-83fd-4e6b413134ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:47.757114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-96d8d104-03bb-4a19-83fd-4e6b413134ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:47.757584 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-96d8d104-03bb-4a19-83fd-4e6b413134ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:47.758285 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-96d8d104-03bb-4a19-83fd-4e6b413134ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:47.758741 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-96d8d104-03bb-4a19-83fd-4e6b413134ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:47.759171 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-96d8d104-03bb-4a19-83fd-4e6b413134ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:47.935027 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-96d8d104-03bb-4a19-83fd-4e6b413134ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:47.943336 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-96d8d104-03bb-4a19-83fd-4e6b413134ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.199248 Aug 04 22:21:47.943917 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 123/252] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:47 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:48.694729 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-893b40eb-5b81-4109-9297-98a270cd3524 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:48.695599 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-893b40eb-5b81-4109-9297-98a270cd3524 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:48.698843 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=72 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:48.707246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-893b40eb-5b81-4109-9297-98a270cd3524 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:48.708010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-893b40eb-5b81-4109-9297-98a270cd3524 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:48.708584 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-893b40eb-5b81-4109-9297-98a270cd3524 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:48.709836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-893b40eb-5b81-4109-9297-98a270cd3524 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:48.710605 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-893b40eb-5b81-4109-9297-98a270cd3524 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:48.711472 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-893b40eb-5b81-4109-9297-98a270cd3524 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:48.761086 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7122e389-6462-4b62-862d-63bf0761593d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:48.762619 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7122e389-6462-4b62-862d-63bf0761593d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:48.771442 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7122e389-6462-4b62-862d-63bf0761593d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:48.772188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7122e389-6462-4b62-862d-63bf0761593d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:48.773051 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7122e389-6462-4b62-862d-63bf0761593d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:48.774104 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7122e389-6462-4b62-862d-63bf0761593d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:48.775105 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7122e389-6462-4b62-862d-63bf0761593d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:48.775696 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7122e389-6462-4b62-862d-63bf0761593d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:48.825322 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7122e389-6462-4b62-862d-63bf0761593d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Going to try to terminate instance {{(pid=129197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:21:48.880107 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-893b40eb-5b81-4109-9297-98a270cd3524 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:48.889649 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-893b40eb-5b81-4109-9297-98a270cd3524 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.199073 Aug 04 22:21:48.901954 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 130/253] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:48 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:48.940839 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7122e389-6462-4b62-862d-63bf0761593d tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "DELETE /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 204 len: 0 microversion: 2.1 time: 0.183415 Aug 04 22:21:48.941604 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 124/254] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:21:48 2022] DELETE /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 22:21:48.951259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c9aa4016-a60e-459d-a93b-92e30db1fe0a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:48.951941 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c9aa4016-a60e-459d-a93b-92e30db1fe0a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:48.966678 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c9aa4016-a60e-459d-a93b-92e30db1fe0a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:48.967450 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c9aa4016-a60e-459d-a93b-92e30db1fe0a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:48.968176 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c9aa4016-a60e-459d-a93b-92e30db1fe0a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:48.969003 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c9aa4016-a60e-459d-a93b-92e30db1fe0a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:48.970605 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c9aa4016-a60e-459d-a93b-92e30db1fe0a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:48.971199 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c9aa4016-a60e-459d-a93b-92e30db1fe0a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:48.974613 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-81267fa1-1a7d-4c32-a323-e0e22f5cc837 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:48.976797 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-81267fa1-1a7d-4c32-a323-e0e22f5cc837 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:48.995718 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81267fa1-1a7d-4c32-a323-e0e22f5cc837 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:48.998599 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81267fa1-1a7d-4c32-a323-e0e22f5cc837 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:48.999408 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81267fa1-1a7d-4c32-a323-e0e22f5cc837 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:49.000827 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81267fa1-1a7d-4c32-a323-e0e22f5cc837 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:49.001607 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81267fa1-1a7d-4c32-a323-e0e22f5cc837 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:49.002257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81267fa1-1a7d-4c32-a323-e0e22f5cc837 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:49.019375 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:49.123949 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c9aa4016-a60e-459d-a93b-92e30db1fe0a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:49.132588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c9aa4016-a60e-459d-a93b-92e30db1fe0a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1557 microversion: 2.1 time: 0.185742 Aug 04 22:21:49.133177 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 131/255] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:48 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1557 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:49.149207 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-81267fa1-1a7d-4c32-a323-e0e22f5cc837 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:49.157457 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-81267fa1-1a7d-4c32-a323-e0e22f5cc837 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.194002 Aug 04 22:21:49.158039 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 125/256] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:48 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:49.911354 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9ff24cfb-49aa-4386-a095-56b48afe1be7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:49.911954 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9ff24cfb-49aa-4386-a095-56b48afe1be7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:49.918202 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9ff24cfb-49aa-4386-a095-56b48afe1be7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:49.918677 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9ff24cfb-49aa-4386-a095-56b48afe1be7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:49.919100 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9ff24cfb-49aa-4386-a095-56b48afe1be7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:49.919778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9ff24cfb-49aa-4386-a095-56b48afe1be7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:49.920220 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9ff24cfb-49aa-4386-a095-56b48afe1be7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:49.920635 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9ff24cfb-49aa-4386-a095-56b48afe1be7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:49.947093 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1972284490", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "networks": [{"uuid": "736dc0c9-0e3b-41d7-a414-8334093d65e7"}]}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:21:50.000299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.network.neutron [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] validate_networks() for [('736dc0c9-0e3b-41d7-a414-8334093d65e7', None, None, None, None, None)] {{(pid=129197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:21:50.051617 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9ff24cfb-49aa-4386-a095-56b48afe1be7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:50.061670 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9ff24cfb-49aa-4386-a095-56b48afe1be7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.153382 Aug 04 22:21:50.063533 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 132/257] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:49 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:50.165560 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-455c1788-205e-4087-9435-d75195f16003 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:50.166419 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-455c1788-205e-4087-9435-d75195f16003 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:50.173707 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-455c1788-205e-4087-9435-d75195f16003 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:50.174963 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-455c1788-205e-4087-9435-d75195f16003 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:50.175511 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-455c1788-205e-4087-9435-d75195f16003 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:50.176495 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-455c1788-205e-4087-9435-d75195f16003 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:50.176774 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-455c1788-205e-4087-9435-d75195f16003 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:50.177265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-455c1788-205e-4087-9435-d75195f16003 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:50.336554 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-455c1788-205e-4087-9435-d75195f16003 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:50.346258 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-455c1788-205e-4087-9435-d75195f16003 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1557 microversion: 2.1 time: 0.195919 Aug 04 22:21:50.346853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 133/258] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:50 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1557 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:50.351296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9267b8bb-adea-4363-aad2-8e0de47b6878 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:50.351890 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9267b8bb-adea-4363-aad2-8e0de47b6878 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:50.358076 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9267b8bb-adea-4363-aad2-8e0de47b6878 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:50.358559 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9267b8bb-adea-4363-aad2-8e0de47b6878 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:50.358990 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9267b8bb-adea-4363-aad2-8e0de47b6878 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:50.359673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9267b8bb-adea-4363-aad2-8e0de47b6878 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:50.361433 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9267b8bb-adea-4363-aad2-8e0de47b6878 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:50.362306 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9267b8bb-adea-4363-aad2-8e0de47b6878 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:50.445515 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Flavor limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:21:50.445942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Image limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:21:50.446480 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Flavor pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:21:50.446892 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Image pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:21:50.447304 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:21:50.460420 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:50.460913 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:50.461347 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:50.462098 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:50.462549 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:50.463034 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:50.482905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Getting quotas for project 9017e927b016427aa84b863e0e2a86a4. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:21:50.488467 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Getting quotas for user 9542521c42b34769a236eb6f268c5358 and project 9017e927b016427aa84b863e0e2a86a4. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:21:50.505124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Going to run 1 instances... {{(pid=129197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:21:50.505357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9267b8bb-adea-4363-aad2-8e0de47b6878 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:50.507508 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:21:50.513695 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9267b8bb-adea-4363-aad2-8e0de47b6878 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.165762 Aug 04 22:21:50.526363 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 134/259] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:50 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:50.555291 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-29ec4b71-7a1c-4439-af11-94d0203275e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.611949 Aug 04 22:21:50.555942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 126/260] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:21:49 2022] POST /compute/v2.1/servers => generated 382 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 04 22:21:50.567753 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-dfd9c3fc-9835-494e-92cc-440c97e66aca tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:50.568458 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-dfd9c3fc-9835-494e-92cc-440c97e66aca tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:50.621740 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-dfd9c3fc-9835-494e-92cc-440c97e66aca tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:50.629605 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-dfd9c3fc-9835-494e-92cc-440c97e66aca tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1218 microversion: 2.1 time: 0.066470 Aug 04 22:21:50.630494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 135/261] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:50 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:51.084520 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-8bde080d-fe58-4fa4-8002-242c9ce68ea6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:51.086257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-8bde080d-fe58-4fa4-8002-242c9ce68ea6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:51.094394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8bde080d-fe58-4fa4-8002-242c9ce68ea6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:51.096034 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8bde080d-fe58-4fa4-8002-242c9ce68ea6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:51.096805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8bde080d-fe58-4fa4-8002-242c9ce68ea6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:51.098026 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8bde080d-fe58-4fa4-8002-242c9ce68ea6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:51.098647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8bde080d-fe58-4fa4-8002-242c9ce68ea6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:51.099744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8bde080d-fe58-4fa4-8002-242c9ce68ea6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:51.366736 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8bde080d-fe58-4fa4-8002-242c9ce68ea6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:51.374537 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-321363c6-a35c-4173-8236-c002f90c93bb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:51.376462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-321363c6-a35c-4173-8236-c002f90c93bb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:51.388215 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-321363c6-a35c-4173-8236-c002f90c93bb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:51.388813 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-321363c6-a35c-4173-8236-c002f90c93bb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:51.389307 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-321363c6-a35c-4173-8236-c002f90c93bb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:51.389782 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-8bde080d-fe58-4fa4-8002-242c9ce68ea6 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1372 microversion: 2.1 time: 0.310357 Aug 04 22:21:51.390550 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-321363c6-a35c-4173-8236-c002f90c93bb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:51.391209 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-321363c6-a35c-4173-8236-c002f90c93bb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:51.391863 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-321363c6-a35c-4173-8236-c002f90c93bb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:51.404062 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 127/262] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:51 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1372 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:51.535454 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1afcfb50-6559-49bb-8f73-3c0fa3c0c20b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:51.536068 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1afcfb50-6559-49bb-8f73-3c0fa3c0c20b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:51.543816 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1afcfb50-6559-49bb-8f73-3c0fa3c0c20b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:51.544372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1afcfb50-6559-49bb-8f73-3c0fa3c0c20b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:51.544808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1afcfb50-6559-49bb-8f73-3c0fa3c0c20b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:51.545534 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1afcfb50-6559-49bb-8f73-3c0fa3c0c20b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:51.546158 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1afcfb50-6559-49bb-8f73-3c0fa3c0c20b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:51.546571 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1afcfb50-6559-49bb-8f73-3c0fa3c0c20b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:51.550579 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-321363c6-a35c-4173-8236-c002f90c93bb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:51.558543 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-321363c6-a35c-4173-8236-c002f90c93bb tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1557 microversion: 2.1 time: 0.195067 Aug 04 22:21:51.559385 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 136/263] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:51 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1557 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:51.659444 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-fd483b15-64ed-4be4-8a93-ae6098409d54 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:51.661753 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-fd483b15-64ed-4be4-8a93-ae6098409d54 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:51.668892 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd483b15-64ed-4be4-8a93-ae6098409d54 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:51.669621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd483b15-64ed-4be4-8a93-ae6098409d54 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:51.670246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd483b15-64ed-4be4-8a93-ae6098409d54 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:51.671141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd483b15-64ed-4be4-8a93-ae6098409d54 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:51.671948 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd483b15-64ed-4be4-8a93-ae6098409d54 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:51.673138 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd483b15-64ed-4be4-8a93-ae6098409d54 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:51.703953 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1afcfb50-6559-49bb-8f73-3c0fa3c0c20b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:51.712998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1afcfb50-6559-49bb-8f73-3c0fa3c0c20b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.181872 Aug 04 22:21:51.713612 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 128/264] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:51 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:51.760403 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-fd483b15-64ed-4be4-8a93-ae6098409d54 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:51.769225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-fd483b15-64ed-4be4-8a93-ae6098409d54 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1222 microversion: 2.1 time: 0.119915 Aug 04 22:21:51.769841 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 137/265] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:51 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1222 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:52.413542 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-370f1b23-969d-41c7-aa4c-3ed85d343859 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:52.414043 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-370f1b23-969d-41c7-aa4c-3ed85d343859 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:52.420728 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-370f1b23-969d-41c7-aa4c-3ed85d343859 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:52.421247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-370f1b23-969d-41c7-aa4c-3ed85d343859 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:52.421700 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-370f1b23-969d-41c7-aa4c-3ed85d343859 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:52.423073 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-370f1b23-969d-41c7-aa4c-3ed85d343859 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:52.424256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-370f1b23-969d-41c7-aa4c-3ed85d343859 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:52.424716 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-370f1b23-969d-41c7-aa4c-3ed85d343859 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:52.580808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-79e4b9cb-0652-4b7e-8ca5-0deba33ae505 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:52.582000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-79e4b9cb-0652-4b7e-8ca5-0deba33ae505 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:52.587577 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-370f1b23-969d-41c7-aa4c-3ed85d343859 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:52.591835 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-79e4b9cb-0652-4b7e-8ca5-0deba33ae505 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:52.592328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-79e4b9cb-0652-4b7e-8ca5-0deba33ae505 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:52.592767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-79e4b9cb-0652-4b7e-8ca5-0deba33ae505 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:52.593496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-79e4b9cb-0652-4b7e-8ca5-0deba33ae505 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:52.593957 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-79e4b9cb-0652-4b7e-8ca5-0deba33ae505 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:52.595042 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-79e4b9cb-0652-4b7e-8ca5-0deba33ae505 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:52.598605 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-370f1b23-969d-41c7-aa4c-3ed85d343859 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1563 microversion: 2.1 time: 0.191970 Aug 04 22:21:52.599185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 129/266] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:52 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1563 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:52.629655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c676705f-6e99-4941-8b8e-d72a51d60fe0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:52.630372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c676705f-6e99-4941-8b8e-d72a51d60fe0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:52.641434 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c676705f-6e99-4941-8b8e-d72a51d60fe0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:52.642991 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c676705f-6e99-4941-8b8e-d72a51d60fe0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:52.643555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c676705f-6e99-4941-8b8e-d72a51d60fe0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:52.644777 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c676705f-6e99-4941-8b8e-d72a51d60fe0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:52.645778 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c676705f-6e99-4941-8b8e-d72a51d60fe0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:52.647364 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c676705f-6e99-4941-8b8e-d72a51d60fe0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:52.794813 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-79e4b9cb-0652-4b7e-8ca5-0deba33ae505 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:52.804637 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-79e4b9cb-0652-4b7e-8ca5-0deba33ae505 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1557 microversion: 2.1 time: 0.228241 Aug 04 22:21:52.805348 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 138/267] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:52 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1557 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:52.810526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-dc9dadc5-b37d-4e80-a95f-9c4b2d3301af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:52.811296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-dc9dadc5-b37d-4e80-a95f-9c4b2d3301af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:52.813369 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c676705f-6e99-4941-8b8e-d72a51d60fe0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.190631 Aug 04 22:21:52.814862 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 130/268] 10.222.0.109 () {58 vars in 1280 bytes} [Thu Aug 4 22:21:52 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:21:52.820694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc9dadc5-b37d-4e80-a95f-9c4b2d3301af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:52.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc9dadc5-b37d-4e80-a95f-9c4b2d3301af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:52.822751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc9dadc5-b37d-4e80-a95f-9c4b2d3301af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:52.823733 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc9dadc5-b37d-4e80-a95f-9c4b2d3301af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:52.827595 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0cd55668-35dd-4fb8-9442-e072e9c57995 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:52.828633 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0cd55668-35dd-4fb8-9442-e072e9c57995 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:52.835142 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc9dadc5-b37d-4e80-a95f-9c4b2d3301af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:52.835603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc9dadc5-b37d-4e80-a95f-9c4b2d3301af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:52.839417 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0cd55668-35dd-4fb8-9442-e072e9c57995 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:52.840033 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0cd55668-35dd-4fb8-9442-e072e9c57995 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:52.840572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0cd55668-35dd-4fb8-9442-e072e9c57995 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:52.841466 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0cd55668-35dd-4fb8-9442-e072e9c57995 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:52.842651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0cd55668-35dd-4fb8-9442-e072e9c57995 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:52.843493 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0cd55668-35dd-4fb8-9442-e072e9c57995 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:53.004936 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-dc9dadc5-b37d-4e80-a95f-9c4b2d3301af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:53.012433 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-dc9dadc5-b37d-4e80-a95f-9c4b2d3301af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.206006 Aug 04 22:21:53.014706 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 139/269] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:52 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:53.073070 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0cd55668-35dd-4fb8-9442-e072e9c57995 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:53.084157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0cd55668-35dd-4fb8-9442-e072e9c57995 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1270 microversion: 2.1 time: 0.267835 Aug 04 22:21:53.085634 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 131/270] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:52 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1270 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:53.828447 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-516b6f12-4766-4d37-a7fc-fc53e596973a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:53.830090 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-516b6f12-4766-4d37-a7fc-fc53e596973a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:53.840775 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-516b6f12-4766-4d37-a7fc-fc53e596973a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:53.842055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-516b6f12-4766-4d37-a7fc-fc53e596973a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:53.842647 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-516b6f12-4766-4d37-a7fc-fc53e596973a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:53.843577 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-516b6f12-4766-4d37-a7fc-fc53e596973a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:53.844247 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-516b6f12-4766-4d37-a7fc-fc53e596973a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:53.844822 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-516b6f12-4766-4d37-a7fc-fc53e596973a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:54.048058 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-02674a1e-a8dc-4803-82fb-af9a389a9a12 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:54.051029 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-02674a1e-a8dc-4803-82fb-af9a389a9a12 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:54.064248 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-02674a1e-a8dc-4803-82fb-af9a389a9a12 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:54.065080 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-02674a1e-a8dc-4803-82fb-af9a389a9a12 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:54.066374 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-02674a1e-a8dc-4803-82fb-af9a389a9a12 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:54.067669 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-02674a1e-a8dc-4803-82fb-af9a389a9a12 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:54.068611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-02674a1e-a8dc-4803-82fb-af9a389a9a12 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:54.069443 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-02674a1e-a8dc-4803-82fb-af9a389a9a12 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:54.154842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-516b6f12-4766-4d37-a7fc-fc53e596973a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:54.169008 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-516b6f12-4766-4d37-a7fc-fc53e596973a tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1557 microversion: 2.1 time: 0.344646 Aug 04 22:21:54.179099 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 140/271] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:53 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1557 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:54.193287 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-cfadb4de-fd01-4a91-ac2b-0ea3512b07e5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:54.195279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-cfadb4de-fd01-4a91-ac2b-0ea3512b07e5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:54.212900 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cfadb4de-fd01-4a91-ac2b-0ea3512b07e5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:54.213645 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cfadb4de-fd01-4a91-ac2b-0ea3512b07e5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:54.220537 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cfadb4de-fd01-4a91-ac2b-0ea3512b07e5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:54.221615 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cfadb4de-fd01-4a91-ac2b-0ea3512b07e5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:54.223580 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cfadb4de-fd01-4a91-ac2b-0ea3512b07e5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:54.224399 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cfadb4de-fd01-4a91-ac2b-0ea3512b07e5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:54.453021 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-02674a1e-a8dc-4803-82fb-af9a389a9a12 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:54.469872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-02674a1e-a8dc-4803-82fb-af9a389a9a12 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.436959 Aug 04 22:21:54.470707 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 132/272] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:54 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:54.534390 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-cfadb4de-fd01-4a91-ac2b-0ea3512b07e5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:54.544580 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-cfadb4de-fd01-4a91-ac2b-0ea3512b07e5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1318 microversion: 2.1 time: 0.360878 Aug 04 22:21:54.545161 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 141/273] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:54 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:54.804809 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-780d9fd0-7b0b-4b53-9850-4fa28ac92453 req-93c4b1b5-3741-479c-b582-993f3cb0427a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09", "name": "network-vif-deleted", "tag": "1d5ab153-937c-4016-8c27-0e52680db3c0"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:21:54.820228 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-780d9fd0-7b0b-4b53-9850-4fa28ac92453 req-93c4b1b5-3741-479c-b582-993f3cb0427a service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:54.824544 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-780d9fd0-7b0b-4b53-9850-4fa28ac92453 req-93c4b1b5-3741-479c-b582-993f3cb0427a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:54.825042 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-780d9fd0-7b0b-4b53-9850-4fa28ac92453 req-93c4b1b5-3741-479c-b582-993f3cb0427a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:54.846127 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-780d9fd0-7b0b-4b53-9850-4fa28ac92453 req-93c4b1b5-3741-479c-b582-993f3cb0427a service nova] Creating event network-vif-deleted:1d5ab153-937c-4016-8c27-0e52680db3c0 for instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 on hv-cinder-85221 Aug 04 22:21:54.852956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-780d9fd0-7b0b-4b53-9850-4fa28ac92453 req-93c4b1b5-3741-479c-b582-993f3cb0427a service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051539 Aug 04 22:21:54.853776 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 133/274] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:21:55.145613 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-4b98afde-d90a-4ee4-9168-f2180a44b0cf req-057dd020-cf0f-44d4-9c59-7be9f8f2cafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80", "tag": "4fd18c5e-4c7e-4edd-b112-1062f5099d87"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:21:55.165825 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-4b98afde-d90a-4ee4-9168-f2180a44b0cf req-057dd020-cf0f-44d4-9c59-7be9f8f2cafd service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:55.166551 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-4b98afde-d90a-4ee4-9168-f2180a44b0cf req-057dd020-cf0f-44d4-9c59-7be9f8f2cafd service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:55.167197 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-4b98afde-d90a-4ee4-9168-f2180a44b0cf req-057dd020-cf0f-44d4-9c59-7be9f8f2cafd service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:55.185869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-4b98afde-d90a-4ee4-9168-f2180a44b0cf req-057dd020-cf0f-44d4-9c59-7be9f8f2cafd service nova] Creating event network-changed:4fd18c5e-4c7e-4edd-b112-1062f5099d87 for instance 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 on hv-cinder-85221 Aug 04 22:21:55.194752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-4b98afde-d90a-4ee4-9168-f2180a44b0cf req-057dd020-cf0f-44d4-9c59-7be9f8f2cafd service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055880 Aug 04 22:21:55.196206 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 142/275] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:21:55.201746 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ef39ba9d-a572-4650-adf9-892026f4ca2c tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:55.202445 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ef39ba9d-a572-4650-adf9-892026f4ca2c tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:55.214018 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ef39ba9d-a572-4650-adf9-892026f4ca2c tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:55.214585 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ef39ba9d-a572-4650-adf9-892026f4ca2c tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:55.214919 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ef39ba9d-a572-4650-adf9-892026f4ca2c tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:55.215616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ef39ba9d-a572-4650-adf9-892026f4ca2c tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:55.216877 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ef39ba9d-a572-4650-adf9-892026f4ca2c tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:55.217478 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ef39ba9d-a572-4650-adf9-892026f4ca2c tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:55.339952 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ef39ba9d-a572-4650-adf9-892026f4ca2c tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b6e8d7c0f94bd5a3ad5bf90386b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721722d703af4087bf9bb3854966b482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:55.372128 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ef39ba9d-a572-4650-adf9-892026f4ca2c tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 200 len: 1349 microversion: 2.1 time: 0.179213 Aug 04 22:21:55.374989 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 134/276] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:55 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 1349 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:55.491950 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ce414fec-f448-4b54-9421-14afc2c20541 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:55.492746 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ce414fec-f448-4b54-9421-14afc2c20541 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:55.506009 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce414fec-f448-4b54-9421-14afc2c20541 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:55.507291 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce414fec-f448-4b54-9421-14afc2c20541 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:55.507743 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce414fec-f448-4b54-9421-14afc2c20541 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:55.510268 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce414fec-f448-4b54-9421-14afc2c20541 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:55.511333 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce414fec-f448-4b54-9421-14afc2c20541 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:55.517566 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ce414fec-f448-4b54-9421-14afc2c20541 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:55.567173 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-fc6ec038-abf7-4769-8f18-7edc66052523 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:55.567982 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-fc6ec038-abf7-4769-8f18-7edc66052523 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:55.592282 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc6ec038-abf7-4769-8f18-7edc66052523 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:55.593807 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc6ec038-abf7-4769-8f18-7edc66052523 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:55.595934 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc6ec038-abf7-4769-8f18-7edc66052523 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:55.598557 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc6ec038-abf7-4769-8f18-7edc66052523 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:55.599267 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc6ec038-abf7-4769-8f18-7edc66052523 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:55.599905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc6ec038-abf7-4769-8f18-7edc66052523 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:55.848303 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-ce414fec-f448-4b54-9421-14afc2c20541 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:55.862626 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ce414fec-f448-4b54-9421-14afc2c20541 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.373026 Aug 04 22:21:55.865210 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-fc6ec038-abf7-4769-8f18-7edc66052523 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:55.879287 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 143/277] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:55 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:55.887906 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-fc6ec038-abf7-4769-8f18-7edc66052523 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1318 microversion: 2.1 time: 0.325385 Aug 04 22:21:55.888509 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 135/278] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:55 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:21:56.395307 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0bf220f6-8749-441f-bacd-783de8f4791e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:56.396033 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0bf220f6-8749-441f-bacd-783de8f4791e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:56.409051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0bf220f6-8749-441f-bacd-783de8f4791e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:56.411593 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0bf220f6-8749-441f-bacd-783de8f4791e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:56.412956 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0bf220f6-8749-441f-bacd-783de8f4791e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:56.414132 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0bf220f6-8749-441f-bacd-783de8f4791e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:56.416064 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0bf220f6-8749-441f-bacd-783de8f4791e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:56.416514 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0bf220f6-8749-441f-bacd-783de8f4791e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:56.433957 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-0bf220f6-8749-441f-bacd-783de8f4791e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] HTTP exception thrown: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0bf220f6-8749-441f-bacd-783de8f4791e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Request method failure captured: Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 HTTP/1.1 Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYjL6QcXJQ-VlyTSkQJdUXtJat6ShSfdbLS5LcCeJlDCDwO050IYTdhvD7P6CJH7TznTqrSO9Du_Aw23kDHpk3gpsrcKje7GRL5APAxsU58CwJM-t6zDmQvFfYAu5VGD_lySuAK-jkf3-T0ShumzOjIoDki-3BfUhEcc8MD8rUdy5k Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 721722d703af4087bf9bb3854966b482 Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-DeleteServersTestJSON-1051821124 Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:21:56.463796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:21:56.465286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/721722d703af4087bf9bb3854966b482"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_721722d703af4087bf9bb3854966b482", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/721722d703af4087bf9bb3854966b482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/721722d703af4087bf9bb3854966b482"}]}] Aug 04 22:21:56.465286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-DeleteServersTestJSON-1051821124 Aug 04 22:21:56.465286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 721722d703af4087bf9bb3854966b482 Aug 04 22:21:56.465286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-DeleteServersTestJSON-1051821124 Aug 04 22:21:56.465286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-DeleteServersTestJSON-1051821124-project Aug 04 22:21:56.465286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:21:56.465286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:21:56.465286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 84b6e8d7c0f94bd5a3ad5bf90386b34c Aug 04 22:21:56.465286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-DeleteServersTestJSON-1051821124-project Aug 04 22:21:56.465286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:21:56.465286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:56.465286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09'} Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:21:56.466028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:56.467143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:21:56.468109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0bf220f6-8749-441f-bacd-783de8f4791e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Returning 404 to user: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:21:56.468109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0bf220f6-8749-441f-bacd-783de8f4791e tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 404 len: 111 microversion: 2.1 time: 0.074719 Aug 04 22:21:56.468334 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 144/279] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:56 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:21:56.617416 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ed83cdf4-c82b-446d-9e08-f3a079a34ba9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:56.620800 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ed83cdf4-c82b-446d-9e08-f3a079a34ba9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:56.635553 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ed83cdf4-c82b-446d-9e08-f3a079a34ba9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:56.636056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ed83cdf4-c82b-446d-9e08-f3a079a34ba9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:56.636496 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ed83cdf4-c82b-446d-9e08-f3a079a34ba9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:56.643476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ed83cdf4-c82b-446d-9e08-f3a079a34ba9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:56.644250 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ed83cdf4-c82b-446d-9e08-f3a079a34ba9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:56.644541 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ed83cdf4-c82b-446d-9e08-f3a079a34ba9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:56.676707 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-ed83cdf4-c82b-446d-9e08-f3a079a34ba9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] HTTP exception thrown: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ed83cdf4-c82b-446d-9e08-f3a079a34ba9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Request method failure captured: Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09/os-volume_attachments HTTP/1.1 Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYjL6QcXJQ-VlyTSkQJdUXtJat6ShSfdbLS5LcCeJlDCDwO050IYTdhvD7P6CJH7TznTqrSO9Du_Aw23kDHpk3gpsrcKje7GRL5APAxsU58CwJM-t6zDmQvFfYAu5VGD_lySuAK-jkf3-T0ShumzOjIoDki-3BfUhEcc8MD8rUdy5k Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 721722d703af4087bf9bb3854966b482 Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-DeleteServersTestJSON-1051821124 Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:21:56.690010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:21:56.691162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/721722d703af4087bf9bb3854966b482"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_721722d703af4087bf9bb3854966b482", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/721722d703af4087bf9bb3854966b482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/721722d703af4087bf9bb3854966b482"}]}] Aug 04 22:21:56.691162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-DeleteServersTestJSON-1051821124 Aug 04 22:21:56.691162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 721722d703af4087bf9bb3854966b482 Aug 04 22:21:56.691162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-DeleteServersTestJSON-1051821124 Aug 04 22:21:56.691162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-DeleteServersTestJSON-1051821124-project Aug 04 22:21:56.691162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:21:56.691162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:21:56.691162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 84b6e8d7c0f94bd5a3ad5bf90386b34c Aug 04 22:21:56.691162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-DeleteServersTestJSON-1051821124-project Aug 04 22:21:56.691162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:21:56.691162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:56.691162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'server_id': 'bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09'} Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:21:56.691941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:56.693069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:21:56.694173 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ed83cdf4-c82b-446d-9e08-f3a079a34ba9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Returning 404 to user: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:21:56.694173 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ed83cdf4-c82b-446d-9e08-f3a079a34ba9 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.081166 Aug 04 22:21:56.697623 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 136/280] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:21:56 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09/os-volume_attachments => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:21:56.886771 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-de5cc350-ff20-4bc8-b7d4-30e23b1fb40c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:56.887396 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-de5cc350-ff20-4bc8-b7d4-30e23b1fb40c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:56.890160 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-7d438571-2084-4fe8-bd82-2c05e14bb9cd req-72cd5bba-35a3-404a-be94-e6edf50027dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9533fa0-d1ed-4df8-9a1f-d754b79c5394", "tag": "fd292742-5a95-4c85-9714-6d6e9bd7487f"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:21:56.895258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-de5cc350-ff20-4bc8-b7d4-30e23b1fb40c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:56.897106 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-de5cc350-ff20-4bc8-b7d4-30e23b1fb40c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:56.897907 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-de5cc350-ff20-4bc8-b7d4-30e23b1fb40c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:56.899773 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-de5cc350-ff20-4bc8-b7d4-30e23b1fb40c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:56.900952 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-de5cc350-ff20-4bc8-b7d4-30e23b1fb40c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:56.901599 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-de5cc350-ff20-4bc8-b7d4-30e23b1fb40c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:56.918121 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-7d438571-2084-4fe8-bd82-2c05e14bb9cd req-72cd5bba-35a3-404a-be94-e6edf50027dd service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:56.919514 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-7d438571-2084-4fe8-bd82-2c05e14bb9cd req-72cd5bba-35a3-404a-be94-e6edf50027dd service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:56.920579 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-7d438571-2084-4fe8-bd82-2c05e14bb9cd req-72cd5bba-35a3-404a-be94-e6edf50027dd service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:56.948365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:56.952200 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-7d438571-2084-4fe8-bd82-2c05e14bb9cd req-72cd5bba-35a3-404a-be94-e6edf50027dd service nova] Creating event network-changed:fd292742-5a95-4c85-9714-6d6e9bd7487f for instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 on hv-cinder-85221 Aug 04 22:21:56.964721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-7d438571-2084-4fe8-bd82-2c05e14bb9cd req-72cd5bba-35a3-404a-be94-e6edf50027dd service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086744 Aug 04 22:21:56.965328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 145/281] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:21:56.995049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3b4a5d98-e9a1-419d-a889-a2ef98184b6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:56.996394 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3b4a5d98-e9a1-419d-a889-a2ef98184b6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:57.006005 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b4a5d98-e9a1-419d-a889-a2ef98184b6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:57.006789 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b4a5d98-e9a1-419d-a889-a2ef98184b6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:57.007216 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b4a5d98-e9a1-419d-a889-a2ef98184b6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:57.008120 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b4a5d98-e9a1-419d-a889-a2ef98184b6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:57.008752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b4a5d98-e9a1-419d-a889-a2ef98184b6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:57.009319 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b4a5d98-e9a1-419d-a889-a2ef98184b6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:57.113115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-de5cc350-ff20-4bc8-b7d4-30e23b1fb40c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:57.123882 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-de5cc350-ff20-4bc8-b7d4-30e23b1fb40c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.242610 Aug 04 22:21:57.124470 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 137/282] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:56 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:57.195337 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3b4a5d98-e9a1-419d-a889-a2ef98184b6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:57.206553 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3b4a5d98-e9a1-419d-a889-a2ef98184b6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1318 microversion: 2.1 time: 0.237015 Aug 04 22:21:57.207540 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 146/283] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:56 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:58.023909 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-5414d70d-d03c-4caa-bc1c-c63b44d21c88 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:58.024390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-5414d70d-d03c-4caa-bc1c-c63b44d21c88 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:58.030659 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5414d70d-d03c-4caa-bc1c-c63b44d21c88 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:58.031187 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5414d70d-d03c-4caa-bc1c-c63b44d21c88 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:58.031733 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5414d70d-d03c-4caa-bc1c-c63b44d21c88 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:58.032400 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5414d70d-d03c-4caa-bc1c-c63b44d21c88 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:58.032855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5414d70d-d03c-4caa-bc1c-c63b44d21c88 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:58.033275 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5414d70d-d03c-4caa-bc1c-c63b44d21c88 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:58.047047 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-5414d70d-d03c-4caa-bc1c-c63b44d21c88 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] HTTP exception thrown: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-5414d70d-d03c-4caa-bc1c-c63b44d21c88 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Request method failure captured: Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: DELETE /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 HTTP/1.1 Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYjL6QcXJQ-VlyTSkQJdUXtJat6ShSfdbLS5LcCeJlDCDwO050IYTdhvD7P6CJH7TznTqrSO9Du_Aw23kDHpk3gpsrcKje7GRL5APAxsU58CwJM-t6zDmQvFfYAu5VGD_lySuAK-jkf3-T0ShumzOjIoDki-3BfUhEcc8MD8rUdy5k Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 721722d703af4087bf9bb3854966b482 Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-DeleteServersTestJSON-1051821124 Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:21:58.049697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:21:58.051053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/721722d703af4087bf9bb3854966b482"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_721722d703af4087bf9bb3854966b482", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/721722d703af4087bf9bb3854966b482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/721722d703af4087bf9bb3854966b482"}]}] Aug 04 22:21:58.051053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-DeleteServersTestJSON-1051821124 Aug 04 22:21:58.051053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 721722d703af4087bf9bb3854966b482 Aug 04 22:21:58.051053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-DeleteServersTestJSON-1051821124 Aug 04 22:21:58.051053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-DeleteServersTestJSON-1051821124-project Aug 04 22:21:58.051053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:21:58.051053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:21:58.051053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 84b6e8d7c0f94bd5a3ad5bf90386b34c Aug 04 22:21:58.051053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-DeleteServersTestJSON-1051821124-project Aug 04 22:21:58.051053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:21:58.051053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:58.051053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': 'bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09'} Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:21:58.051706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:58.052711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:21:58.056324 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-5414d70d-d03c-4caa-bc1c-c63b44d21c88 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Returning 404 to user: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:21:58.057300 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-5414d70d-d03c-4caa-bc1c-c63b44d21c88 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "DELETE /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 404 len: 111 microversion: 2.1 time: 0.037519 Aug 04 22:21:58.057939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 138/284] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:21:58 2022] DELETE /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:21:58.066959 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3441ef9b-edc0-4784-9bdc-76870ff8c1f8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:58.067823 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3441ef9b-edc0-4784-9bdc-76870ff8c1f8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] [instance: bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:58.074432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3441ef9b-edc0-4784-9bdc-76870ff8c1f8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:58.075137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3441ef9b-edc0-4784-9bdc-76870ff8c1f8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:58.075568 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3441ef9b-edc0-4784-9bdc-76870ff8c1f8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:58.076272 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3441ef9b-edc0-4784-9bdc-76870ff8c1f8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:58.076741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3441ef9b-edc0-4784-9bdc-76870ff8c1f8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:58.077156 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3441ef9b-edc0-4784-9bdc-76870ff8c1f8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:58.092301 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-3441ef9b-edc0-4784-9bdc-76870ff8c1f8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] HTTP exception thrown: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3441ef9b-edc0-4784-9bdc-76870ff8c1f8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Request method failure captured: Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 HTTP/1.1 Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYjL6QcXJQ-VlyTSkQJdUXtJat6ShSfdbLS5LcCeJlDCDwO050IYTdhvD7P6CJH7TznTqrSO9Du_Aw23kDHpk3gpsrcKje7GRL5APAxsU58CwJM-t6zDmQvFfYAu5VGD_lySuAK-jkf3-T0ShumzOjIoDki-3BfUhEcc8MD8rUdy5k Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 721722d703af4087bf9bb3854966b482 Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-DeleteServersTestJSON-1051821124 Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:21:58.094026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:21:58.095302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/721722d703af4087bf9bb3854966b482"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_721722d703af4087bf9bb3854966b482", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/721722d703af4087bf9bb3854966b482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/721722d703af4087bf9bb3854966b482"}]}] Aug 04 22:21:58.095302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-DeleteServersTestJSON-1051821124 Aug 04 22:21:58.095302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 721722d703af4087bf9bb3854966b482 Aug 04 22:21:58.095302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-DeleteServersTestJSON-1051821124 Aug 04 22:21:58.095302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-DeleteServersTestJSON-1051821124-project Aug 04 22:21:58.095302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:21:58.095302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:21:58.095302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 84b6e8d7c0f94bd5a3ad5bf90386b34c Aug 04 22:21:58.095302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-DeleteServersTestJSON-1051821124-project Aug 04 22:21:58.095302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:21:58.095302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:58.095302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09'} Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:21:58.096237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. Aug 04 22:21:58.097314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:21:58.098633 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3441ef9b-edc0-4784-9bdc-76870ff8c1f8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] Returning 404 to user: Instance bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:21:58.098633 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3441ef9b-edc0-4784-9bdc-76870ff8c1f8 tempest-DeleteServersTestJSON-1051821124 tempest-DeleteServersTestJSON-1051821124-project] 10.222.0.109 "GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09" status: 404 len: 111 microversion: 2.1 time: 0.033197 Aug 04 22:21:58.098633 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 147/285] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:58 2022] GET /compute/v2.1/servers/bcc8f3a9-7dc7-45b8-bdca-ece6f91f1c09 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:21:58.146393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bd905efc-badf-4bdc-b925-ad0aa038321e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:58.147020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bd905efc-badf-4bdc-b925-ad0aa038321e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:58.154188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd905efc-badf-4bdc-b925-ad0aa038321e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:58.154682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd905efc-badf-4bdc-b925-ad0aa038321e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:58.155119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd905efc-badf-4bdc-b925-ad0aa038321e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:58.157155 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd905efc-badf-4bdc-b925-ad0aa038321e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:58.158306 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd905efc-badf-4bdc-b925-ad0aa038321e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:58.158864 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd905efc-badf-4bdc-b925-ad0aa038321e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:58.231998 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-45fade8b-6140-40ae-9810-e619e313f903 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:58.232691 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-45fade8b-6140-40ae-9810-e619e313f903 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:58.250469 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45fade8b-6140-40ae-9810-e619e313f903 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:58.251634 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45fade8b-6140-40ae-9810-e619e313f903 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:58.252466 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45fade8b-6140-40ae-9810-e619e313f903 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:58.254374 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45fade8b-6140-40ae-9810-e619e313f903 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:58.264988 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45fade8b-6140-40ae-9810-e619e313f903 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:58.265155 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45fade8b-6140-40ae-9810-e619e313f903 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:58.373122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bd905efc-badf-4bdc-b925-ad0aa038321e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:58.381612 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bd905efc-badf-4bdc-b925-ad0aa038321e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.238910 Aug 04 22:21:58.382202 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 139/286] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:58 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:58.553063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-45fade8b-6140-40ae-9810-e619e313f903 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:58.562198 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-45fade8b-6140-40ae-9810-e619e313f903 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1318 microversion: 2.1 time: 0.337552 Aug 04 22:21:58.563777 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 148/287] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:58 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:21:59.403188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2e2ebe3b-54ae-459d-94f7-19e129c39ba4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:59.411015 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2e2ebe3b-54ae-459d-94f7-19e129c39ba4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:59.421730 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e2ebe3b-54ae-459d-94f7-19e129c39ba4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:59.422526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e2ebe3b-54ae-459d-94f7-19e129c39ba4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:59.423165 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e2ebe3b-54ae-459d-94f7-19e129c39ba4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:59.423887 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e2ebe3b-54ae-459d-94f7-19e129c39ba4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:59.424351 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e2ebe3b-54ae-459d-94f7-19e129c39ba4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:59.424780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e2ebe3b-54ae-459d-94f7-19e129c39ba4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:59.588739 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-72b798c7-bde1-4c50-8c50-6f9350d52108 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:21:59.592612 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-72b798c7-bde1-4c50-8c50-6f9350d52108 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:21:59.615508 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-72b798c7-bde1-4c50-8c50-6f9350d52108 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:59.616462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-72b798c7-bde1-4c50-8c50-6f9350d52108 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:59.617108 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-72b798c7-bde1-4c50-8c50-6f9350d52108 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:59.618119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-72b798c7-bde1-4c50-8c50-6f9350d52108 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:21:59.618791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-72b798c7-bde1-4c50-8c50-6f9350d52108 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:21:59.620328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-72b798c7-bde1-4c50-8c50-6f9350d52108 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:21:59.724513 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2e2ebe3b-54ae-459d-94f7-19e129c39ba4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:21:59.741630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2e2ebe3b-54ae-459d-94f7-19e129c39ba4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.342548 Aug 04 22:21:59.742544 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 140/288] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:59 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:00.063183 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-72b798c7-bde1-4c50-8c50-6f9350d52108 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:00.070620 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-72b798c7-bde1-4c50-8c50-6f9350d52108 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1318 microversion: 2.1 time: 0.489745 Aug 04 22:22:00.081772 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 149/289] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:21:59 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:00.768646 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-324a8cc3-da6b-4758-9a7d-069d1c7ed44c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:00.769265 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-324a8cc3-da6b-4758-9a7d-069d1c7ed44c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:00.772517 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:00.773313 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=6 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:00.778702 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-324a8cc3-da6b-4758-9a7d-069d1c7ed44c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:00.779325 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-324a8cc3-da6b-4758-9a7d-069d1c7ed44c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:00.779813 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-324a8cc3-da6b-4758-9a7d-069d1c7ed44c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:00.780661 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-324a8cc3-da6b-4758-9a7d-069d1c7ed44c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:00.781452 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-324a8cc3-da6b-4758-9a7d-069d1c7ed44c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:00.781981 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-324a8cc3-da6b-4758-9a7d-069d1c7ed44c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:01.035319 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-324a8cc3-da6b-4758-9a7d-069d1c7ed44c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:01.048794 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-324a8cc3-da6b-4758-9a7d-069d1c7ed44c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.284804 Aug 04 22:22:01.050102 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 141/290] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:00 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:01.094638 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-cbd08717-d214-4b3d-a3bc-3f261c2d13f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:01.095257 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-cbd08717-d214-4b3d-a3bc-3f261c2d13f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:01.097587 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:01.103768 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cbd08717-d214-4b3d-a3bc-3f261c2d13f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:01.104513 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cbd08717-d214-4b3d-a3bc-3f261c2d13f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:01.105107 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cbd08717-d214-4b3d-a3bc-3f261c2d13f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:01.106019 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cbd08717-d214-4b3d-a3bc-3f261c2d13f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:01.106648 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cbd08717-d214-4b3d-a3bc-3f261c2d13f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:01.107263 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cbd08717-d214-4b3d-a3bc-3f261c2d13f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:01.275730 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-cbd08717-d214-4b3d-a3bc-3f261c2d13f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:01.284946 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-cbd08717-d214-4b3d-a3bc-3f261c2d13f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1318 microversion: 2.1 time: 0.195086 Aug 04 22:22:01.298590 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 150/291] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:01 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:01.834194 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-65b13887-2adb-422f-a06f-9244d272353b req-00242f49-f6c1-4f30-8221-a3a025b45198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80", "name": "network-vif-plugged", "status": "completed", "tag": "4fd18c5e-4c7e-4edd-b112-1062f5099d87"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:22:01.846491 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-65b13887-2adb-422f-a06f-9244d272353b req-00242f49-f6c1-4f30-8221-a3a025b45198 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:01.847211 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-65b13887-2adb-422f-a06f-9244d272353b req-00242f49-f6c1-4f30-8221-a3a025b45198 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:01.847970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-65b13887-2adb-422f-a06f-9244d272353b req-00242f49-f6c1-4f30-8221-a3a025b45198 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:01.865759 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-65b13887-2adb-422f-a06f-9244d272353b req-00242f49-f6c1-4f30-8221-a3a025b45198 service nova] Creating event network-vif-plugged:4fd18c5e-4c7e-4edd-b112-1062f5099d87 for instance 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 on hv-cinder-85221 Aug 04 22:22:01.871439 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-65b13887-2adb-422f-a06f-9244d272353b req-00242f49-f6c1-4f30-8221-a3a025b45198 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041113 Aug 04 22:22:01.873131 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 142/292] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:22:02.071495 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a33bf5cb-21ef-4873-9565-426f7319a866 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:02.072414 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a33bf5cb-21ef-4873-9565-426f7319a866 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:02.086483 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a33bf5cb-21ef-4873-9565-426f7319a866 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:02.088691 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a33bf5cb-21ef-4873-9565-426f7319a866 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:02.090742 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a33bf5cb-21ef-4873-9565-426f7319a866 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:02.091917 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a33bf5cb-21ef-4873-9565-426f7319a866 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:02.094989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a33bf5cb-21ef-4873-9565-426f7319a866 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:02.095585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a33bf5cb-21ef-4873-9565-426f7319a866 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:02.312547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-10fc30f0-f76a-473c-9809-4a46d5af75b0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:02.315453 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-10fc30f0-f76a-473c-9809-4a46d5af75b0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:02.328172 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-10fc30f0-f76a-473c-9809-4a46d5af75b0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:02.328728 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-10fc30f0-f76a-473c-9809-4a46d5af75b0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:02.329125 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-10fc30f0-f76a-473c-9809-4a46d5af75b0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:02.332108 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-10fc30f0-f76a-473c-9809-4a46d5af75b0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:02.335605 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-10fc30f0-f76a-473c-9809-4a46d5af75b0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:02.336070 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-10fc30f0-f76a-473c-9809-4a46d5af75b0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:02.359738 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a33bf5cb-21ef-4873-9565-426f7319a866 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:02.369789 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a33bf5cb-21ef-4873-9565-426f7319a866 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.302700 Aug 04 22:22:02.372208 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 151/293] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:02 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:02.553269 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-10fc30f0-f76a-473c-9809-4a46d5af75b0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:02.562045 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-10fc30f0-f76a-473c-9809-4a46d5af75b0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1318 microversion: 2.1 time: 0.257017 Aug 04 22:22:02.564206 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 143/294] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:02 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:03.394485 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-97a1db76-78a4-4cda-82df-a1d4d262bedd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:03.395313 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-97a1db76-78a4-4cda-82df-a1d4d262bedd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:03.401571 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-97a1db76-78a4-4cda-82df-a1d4d262bedd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:03.402060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-97a1db76-78a4-4cda-82df-a1d4d262bedd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:03.402494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-97a1db76-78a4-4cda-82df-a1d4d262bedd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:03.403188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-97a1db76-78a4-4cda-82df-a1d4d262bedd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:03.403645 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-97a1db76-78a4-4cda-82df-a1d4d262bedd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:03.404070 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-97a1db76-78a4-4cda-82df-a1d4d262bedd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:03.583406 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-97a1db76-78a4-4cda-82df-a1d4d262bedd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:03.584991 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bd2fac64-68b6-4529-b756-35652cd40937 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:03.585636 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bd2fac64-68b6-4529-b756-35652cd40937 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:03.592533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd2fac64-68b6-4529-b756-35652cd40937 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:03.593908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-97a1db76-78a4-4cda-82df-a1d4d262bedd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.203943 Aug 04 22:22:03.594262 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd2fac64-68b6-4529-b756-35652cd40937 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:03.595331 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 152/295] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:03 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:03.606471 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd2fac64-68b6-4529-b756-35652cd40937 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:03.607427 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd2fac64-68b6-4529-b756-35652cd40937 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:03.611103 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd2fac64-68b6-4529-b756-35652cd40937 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:03.611746 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd2fac64-68b6-4529-b756-35652cd40937 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:03.756132 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bd2fac64-68b6-4529-b756-35652cd40937 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:03.763880 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bd2fac64-68b6-4529-b756-35652cd40937 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1318 microversion: 2.1 time: 0.182798 Aug 04 22:22:03.764484 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 144/296] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:03 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:04.618370 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-de01ed57-d605-4559-bb01-a5a0b9b734a8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:04.618837 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-de01ed57-d605-4559-bb01-a5a0b9b734a8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:04.627071 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de01ed57-d605-4559-bb01-a5a0b9b734a8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:04.627573 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de01ed57-d605-4559-bb01-a5a0b9b734a8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:04.628020 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de01ed57-d605-4559-bb01-a5a0b9b734a8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:04.628710 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de01ed57-d605-4559-bb01-a5a0b9b734a8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:04.629167 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de01ed57-d605-4559-bb01-a5a0b9b734a8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:04.629722 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de01ed57-d605-4559-bb01-a5a0b9b734a8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:04.763751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-de01ed57-d605-4559-bb01-a5a0b9b734a8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:04.771448 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-de01ed57-d605-4559-bb01-a5a0b9b734a8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.157106 Aug 04 22:22:04.772040 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 153/297] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:04 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:04.790899 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7b88d39f-3525-439c-aa1a-313452fb19c7 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:04.791578 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7b88d39f-3525-439c-aa1a-313452fb19c7 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:04.798284 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b88d39f-3525-439c-aa1a-313452fb19c7 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:04.798767 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b88d39f-3525-439c-aa1a-313452fb19c7 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:04.799194 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b88d39f-3525-439c-aa1a-313452fb19c7 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:04.799885 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b88d39f-3525-439c-aa1a-313452fb19c7 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:04.800336 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b88d39f-3525-439c-aa1a-313452fb19c7 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:04.800750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b88d39f-3525-439c-aa1a-313452fb19c7 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:04.943231 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7b88d39f-3525-439c-aa1a-313452fb19c7 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:04.945653 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=100 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:04.952215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7b88d39f-3525-439c-aa1a-313452fb19c7 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1318 microversion: 2.1 time: 0.165263 Aug 04 22:22:04.953487 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 145/298] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:04 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:05.791893 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9284f7d8-efa7-419d-9c20-b57c2af5fb30 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:05.792592 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9284f7d8-efa7-419d-9c20-b57c2af5fb30 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:05.799104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9284f7d8-efa7-419d-9c20-b57c2af5fb30 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:05.799593 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9284f7d8-efa7-419d-9c20-b57c2af5fb30 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:05.800027 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9284f7d8-efa7-419d-9c20-b57c2af5fb30 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:05.800736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9284f7d8-efa7-419d-9c20-b57c2af5fb30 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:05.801163 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9284f7d8-efa7-419d-9c20-b57c2af5fb30 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:05.801618 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9284f7d8-efa7-419d-9c20-b57c2af5fb30 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:05.940253 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9284f7d8-efa7-419d-9c20-b57c2af5fb30 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:05.948431 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9284f7d8-efa7-419d-9c20-b57c2af5fb30 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.160344 Aug 04 22:22:05.949072 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 154/299] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:05 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:05.981818 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f9a52b8a-ec1a-49bf-b669-c67c591037f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:05.982566 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f9a52b8a-ec1a-49bf-b669-c67c591037f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:05.988460 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9a52b8a-ec1a-49bf-b669-c67c591037f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:05.988935 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9a52b8a-ec1a-49bf-b669-c67c591037f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:05.989362 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9a52b8a-ec1a-49bf-b669-c67c591037f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:05.990082 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9a52b8a-ec1a-49bf-b669-c67c591037f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:05.990526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9a52b8a-ec1a-49bf-b669-c67c591037f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:05.991119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9a52b8a-ec1a-49bf-b669-c67c591037f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:06.143909 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f9a52b8a-ec1a-49bf-b669-c67c591037f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:06.151822 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f9a52b8a-ec1a-49bf-b669-c67c591037f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1318 microversion: 2.1 time: 0.174385 Aug 04 22:22:06.152383 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 146/300] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:05 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:06.970283 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-53a20e2e-f8a7-4750-bfb7-d4a74fe5f2b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:06.970914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-53a20e2e-f8a7-4750-bfb7-d4a74fe5f2b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:06.977292 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-53a20e2e-f8a7-4750-bfb7-d4a74fe5f2b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:06.977811 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-53a20e2e-f8a7-4750-bfb7-d4a74fe5f2b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:06.978247 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-53a20e2e-f8a7-4750-bfb7-d4a74fe5f2b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:06.978939 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-53a20e2e-f8a7-4750-bfb7-d4a74fe5f2b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:06.979393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-53a20e2e-f8a7-4750-bfb7-d4a74fe5f2b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:06.979818 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-53a20e2e-f8a7-4750-bfb7-d4a74fe5f2b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:07.118473 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-53a20e2e-f8a7-4750-bfb7-d4a74fe5f2b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:07.126928 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-53a20e2e-f8a7-4750-bfb7-d4a74fe5f2b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.161190 Aug 04 22:22:07.127497 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 155/301] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:06 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:07.173608 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6b6c18a7-7a77-44f2-be83-f4818b6623da tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:07.174336 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6b6c18a7-7a77-44f2-be83-f4818b6623da tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:07.180378 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6b6c18a7-7a77-44f2-be83-f4818b6623da tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:07.180870 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6b6c18a7-7a77-44f2-be83-f4818b6623da tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:07.181308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6b6c18a7-7a77-44f2-be83-f4818b6623da tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:07.182123 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6b6c18a7-7a77-44f2-be83-f4818b6623da tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:07.182568 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6b6c18a7-7a77-44f2-be83-f4818b6623da tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:07.183874 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6b6c18a7-7a77-44f2-be83-f4818b6623da tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:07.311062 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6b6c18a7-7a77-44f2-be83-f4818b6623da tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:07.318877 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6b6c18a7-7a77-44f2-be83-f4818b6623da tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1318 microversion: 2.1 time: 0.150245 Aug 04 22:22:07.319454 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 147/302] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:07 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:08.147533 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-19112082-adb9-4bab-96d7-4e124fc40810 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:08.148141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-19112082-adb9-4bab-96d7-4e124fc40810 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:08.154780 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19112082-adb9-4bab-96d7-4e124fc40810 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:08.155261 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19112082-adb9-4bab-96d7-4e124fc40810 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:08.155771 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19112082-adb9-4bab-96d7-4e124fc40810 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:08.156515 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19112082-adb9-4bab-96d7-4e124fc40810 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:08.156962 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19112082-adb9-4bab-96d7-4e124fc40810 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:08.157379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19112082-adb9-4bab-96d7-4e124fc40810 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:08.213886 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d3c1ade2-c2cb-4109-8b87-968d1c31a760 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] Calling method '.version_select at 0x7fe7b197b670>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:08.266780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d3c1ade2-c2cb-4109-8b87-968d1c31a760 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/faeacb65-7b79-42e8-a5d5-37b5ea068c49" status: 200 len: 351 microversion: 2.1 time: 0.056621 Aug 04 22:22:08.273510 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 148/303] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:22:08 2022] GET /compute/v2.1/os-volumes/faeacb65-7b79-42e8-a5d5-37b5ea068c49 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:22:08.329040 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-19112082-adb9-4bab-96d7-4e124fc40810 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:08.339420 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-667ffd4a-fead-451a-a719-484a88d9cf43 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:08.340825 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-667ffd4a-fead-451a-a719-484a88d9cf43 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:08.342313 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-19112082-adb9-4bab-96d7-4e124fc40810 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.198385 Aug 04 22:22:08.343072 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 156/304] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:08 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:08.356673 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-667ffd4a-fead-451a-a719-484a88d9cf43 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:08.356673 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-667ffd4a-fead-451a-a719-484a88d9cf43 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:08.356673 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-667ffd4a-fead-451a-a719-484a88d9cf43 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:08.356673 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-667ffd4a-fead-451a-a719-484a88d9cf43 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:08.357179 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-667ffd4a-fead-451a-a719-484a88d9cf43 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:08.357179 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-667ffd4a-fead-451a-a719-484a88d9cf43 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:08.578298 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-667ffd4a-fead-451a-a719-484a88d9cf43 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:08.586477 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-667ffd4a-fead-451a-a719-484a88d9cf43 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1318 microversion: 2.1 time: 0.250841 Aug 04 22:22:08.587330 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 149/305] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:08 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:09.364112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d1af4fe3-070a-45e9-93eb-d1caa0eccaf1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:09.364724 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d1af4fe3-070a-45e9-93eb-d1caa0eccaf1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:09.371175 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1af4fe3-070a-45e9-93eb-d1caa0eccaf1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:09.371856 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1af4fe3-070a-45e9-93eb-d1caa0eccaf1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:09.372293 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1af4fe3-070a-45e9-93eb-d1caa0eccaf1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:09.372983 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1af4fe3-070a-45e9-93eb-d1caa0eccaf1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:09.373467 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1af4fe3-070a-45e9-93eb-d1caa0eccaf1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:09.373896 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1af4fe3-070a-45e9-93eb-d1caa0eccaf1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:09.607945 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f151a054-fb10-4f63-87c6-93395cfcb3e4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:09.608822 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f151a054-fb10-4f63-87c6-93395cfcb3e4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:09.617551 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f151a054-fb10-4f63-87c6-93395cfcb3e4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:09.618335 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f151a054-fb10-4f63-87c6-93395cfcb3e4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:09.618899 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f151a054-fb10-4f63-87c6-93395cfcb3e4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:09.619808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f151a054-fb10-4f63-87c6-93395cfcb3e4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:09.620535 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f151a054-fb10-4f63-87c6-93395cfcb3e4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:09.621082 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f151a054-fb10-4f63-87c6-93395cfcb3e4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:09.648979 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d1af4fe3-070a-45e9-93eb-d1caa0eccaf1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:09.665102 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d1af4fe3-070a-45e9-93eb-d1caa0eccaf1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.304800 Aug 04 22:22:09.665899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 157/306] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:09 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:09.771646 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f151a054-fb10-4f63-87c6-93395cfcb3e4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:09.784111 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f151a054-fb10-4f63-87c6-93395cfcb3e4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1500 microversion: 2.1 time: 0.178389 Aug 04 22:22:09.795710 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 150/307] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:09 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1500 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:10.686900 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-19d9cc03-4fdd-4a25-ab02-96903f4bdd1e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:10.687518 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-19d9cc03-4fdd-4a25-ab02-96903f4bdd1e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:10.694505 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19d9cc03-4fdd-4a25-ab02-96903f4bdd1e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:10.694992 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19d9cc03-4fdd-4a25-ab02-96903f4bdd1e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:10.695427 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19d9cc03-4fdd-4a25-ab02-96903f4bdd1e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:10.696117 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19d9cc03-4fdd-4a25-ab02-96903f4bdd1e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:10.696572 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19d9cc03-4fdd-4a25-ab02-96903f4bdd1e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:10.696996 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19d9cc03-4fdd-4a25-ab02-96903f4bdd1e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:10.828365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-19d9cc03-4fdd-4a25-ab02-96903f4bdd1e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:10.836549 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-19d9cc03-4fdd-4a25-ab02-96903f4bdd1e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.153574 Aug 04 22:22:10.837118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 158/308] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:10 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:10.926563 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d20e262e-12e8-4c40-b704-ccddb62f61e3 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] Calling method '.version_select at 0x7fe7b1a848b0>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:10.977675 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d20e262e-12e8-4c40-b704-ccddb62f61e3 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/1805023c-1281-4f2b-8069-89f9291348d8" status: 200 len: 351 microversion: 2.1 time: 0.055801 Aug 04 22:22:10.978262 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 151/309] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:22:10 2022] GET /compute/v2.1/os-volumes/1805023c-1281-4f2b-8069-89f9291348d8 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:22:11.029635 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7819c85d-8962-4917-8205-7805bcb7c0ff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:11.030245 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7819c85d-8962-4917-8205-7805bcb7c0ff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:11.037610 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7819c85d-8962-4917-8205-7805bcb7c0ff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:11.038295 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7819c85d-8962-4917-8205-7805bcb7c0ff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:11.038757 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7819c85d-8962-4917-8205-7805bcb7c0ff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:11.039630 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7819c85d-8962-4917-8205-7805bcb7c0ff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:11.040091 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7819c85d-8962-4917-8205-7805bcb7c0ff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:11.040501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7819c85d-8962-4917-8205-7805bcb7c0ff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:11.074391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7819c85d-8962-4917-8205-7805bcb7c0ff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Going to try to terminate instance {{(pid=129196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:22:11.197380 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7819c85d-8962-4917-8205-7805bcb7c0ff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "DELETE /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 204 len: 0 microversion: 2.1 time: 0.171355 Aug 04 22:22:11.198262 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 159/310] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:22:11 2022] DELETE /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:22:11.207433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a6e1746d-2f49-44ec-bd6b-bb9849a05634 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:11.208383 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a6e1746d-2f49-44ec-bd6b-bb9849a05634 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:11.214969 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6e1746d-2f49-44ec-bd6b-bb9849a05634 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:11.215493 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6e1746d-2f49-44ec-bd6b-bb9849a05634 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:11.216026 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6e1746d-2f49-44ec-bd6b-bb9849a05634 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:11.216883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6e1746d-2f49-44ec-bd6b-bb9849a05634 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:11.217336 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6e1746d-2f49-44ec-bd6b-bb9849a05634 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:11.217786 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6e1746d-2f49-44ec-bd6b-bb9849a05634 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:11.457533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a6e1746d-2f49-44ec-bd6b-bb9849a05634 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:11.465855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a6e1746d-2f49-44ec-bd6b-bb9849a05634 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1506 microversion: 2.1 time: 0.263002 Aug 04 22:22:11.477760 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 152/311] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:11 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:11.859545 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-78668b51-8b7c-4a37-957d-682e61298b52 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:11.860239 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-78668b51-8b7c-4a37-957d-682e61298b52 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:11.870621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-78668b51-8b7c-4a37-957d-682e61298b52 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:11.872244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-78668b51-8b7c-4a37-957d-682e61298b52 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:11.873237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-78668b51-8b7c-4a37-957d-682e61298b52 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:11.874582 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-78668b51-8b7c-4a37-957d-682e61298b52 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:11.875583 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-78668b51-8b7c-4a37-957d-682e61298b52 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:11.877215 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-78668b51-8b7c-4a37-957d-682e61298b52 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:12.045251 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-78668b51-8b7c-4a37-957d-682e61298b52 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:12.056367 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-78668b51-8b7c-4a37-957d-682e61298b52 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.200848 Aug 04 22:22:12.057070 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 160/312] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:11 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:12.434958 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-51017d4d-fff8-436f-b631-fd4527eb21dc tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] Calling method '.version_select at 0x7fe7b1a840d0>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:12.488744 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-fe99597d-4002-463a-8b46-a9bf0f5950b3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:12.489834 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-fe99597d-4002-463a-8b46-a9bf0f5950b3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:12.492739 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-51017d4d-fff8-436f-b631-fd4527eb21dc tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/c9f6f21b-682e-48e6-89f5-04263ff1ae8f" status: 200 len: 349 microversion: 2.1 time: 0.061644 Aug 04 22:22:12.494228 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 153/313] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:22:12 2022] GET /compute/v2.1/os-volumes/c9f6f21b-682e-48e6-89f5-04263ff1ae8f => generated 349 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:22:12.498076 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe99597d-4002-463a-8b46-a9bf0f5950b3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:12.498567 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe99597d-4002-463a-8b46-a9bf0f5950b3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:12.499199 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe99597d-4002-463a-8b46-a9bf0f5950b3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:12.500043 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe99597d-4002-463a-8b46-a9bf0f5950b3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:12.500504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe99597d-4002-463a-8b46-a9bf0f5950b3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:12.500933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe99597d-4002-463a-8b46-a9bf0f5950b3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:12.509804 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4aa48289-f5c5-4082-9868-f970590bb734 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] Calling method '.version_select at 0x7fe7b197f280>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:12.522567 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:12.611731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4aa48289-f5c5-4082-9868-f970590bb734 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] 10.222.0.109 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.107802 Aug 04 22:22:12.612369 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 154/314] 10.222.0.109 () {58 vars in 1139 bytes} [Thu Aug 4 22:22:12 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:12.626493 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-40b0bbf8-2e08-441e-bc16-31c9d561acff tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] Calling method '.version_select at 0x7fe7b198b280>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:12.708097 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-fe99597d-4002-463a-8b46-a9bf0f5950b3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:12.716729 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-fe99597d-4002-463a-8b46-a9bf0f5950b3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1506 microversion: 2.1 time: 0.232917 Aug 04 22:22:12.717875 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 161/315] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:12 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:12.722392 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-40b0bbf8-2e08-441e-bc16-31c9d561acff tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] 10.222.0.109 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.099615 Aug 04 22:22:12.723554 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 155/316] 10.222.0.109 () {58 vars in 1154 bytes} [Thu Aug 4 22:22:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:22:12.739432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5f38a241-f0fc-43d8-82ee-774f050c8509 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] Calling method '.version_select at 0x7fe7b222c0d0>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:12.830301 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5f38a241-f0fc-43d8-82ee-774f050c8509 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] 10.222.0.109 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.097051 Aug 04 22:22:12.831056 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 162/317] 10.222.0.109 () {58 vars in 1139 bytes} [Thu Aug 4 22:22:12 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:12.844144 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6ed5352b-8176-41e1-8697-0efeadb3ee19 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] Calling method '.version_select at 0x7fe7b198baf0>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:12.933556 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6ed5352b-8176-41e1-8697-0efeadb3ee19 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] 10.222.0.109 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093126 Aug 04 22:22:12.934182 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 156/318] 10.222.0.109 () {58 vars in 1172 bytes} [Thu Aug 4 22:22:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:22:12.947729 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-761033fe-e72d-46fd-8e75-b6d7f8c3d3f7 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] Calling method '.version_select at 0x7fe7b2206c10>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:13.040536 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-761033fe-e72d-46fd-8e75-b6d7f8c3d3f7 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.096905 Aug 04 22:22:13.041352 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 163/319] 10.222.0.109 () {58 vars in 1175 bytes} [Thu Aug 4 22:22:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:22:13.055947 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-86038c1d-3d88-430a-a36e-a34c5f93ca3c tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] Calling method '.version_select at 0x7fe7b1a84a60>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:13.077988 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-16d88a83-0538-4a63-a704-39014d1549b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:13.078852 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-16d88a83-0538-4a63-a704-39014d1549b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:13.086550 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-16d88a83-0538-4a63-a704-39014d1549b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:13.087134 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-16d88a83-0538-4a63-a704-39014d1549b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:13.087897 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-16d88a83-0538-4a63-a704-39014d1549b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:13.088807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-16d88a83-0538-4a63-a704-39014d1549b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:13.089321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-16d88a83-0538-4a63-a704-39014d1549b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:13.089853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-16d88a83-0538-4a63-a704-39014d1549b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:13.150791 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-86038c1d-3d88-430a-a36e-a34c5f93ca3c tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.099712 Aug 04 22:22:13.151562 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 157/320] 10.222.0.109 () {58 vars in 1160 bytes} [Thu Aug 4 22:22:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:13.172720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-39aaa872-5d8b-45f6-9a6e-30e5b94bccfc tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] Calling method '.version_select at 0x7fe7b197fee0>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:13.262818 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-39aaa872-5d8b-45f6-9a6e-30e5b94bccfc tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094524 Aug 04 22:22:13.263683 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 158/321] 10.222.0.109 () {58 vars in 1193 bytes} [Thu Aug 4 22:22:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:22:13.277070 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-fd65b349-307c-42ba-bcf2-439d82209445 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] Calling method '.version_select at 0x7fe7b197f280>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:13.296853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-16d88a83-0538-4a63-a704-39014d1549b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:13.319849 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-16d88a83-0538-4a63-a704-39014d1549b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1526 microversion: 2.1 time: 0.246105 Aug 04 22:22:13.334135 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 164/322] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:13 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1526 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:13.383083 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-fd65b349-307c-42ba-bcf2-439d82209445 tempest-VolumesTestJSON-456394525 tempest-VolumesTestJSON-456394525-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.109546 Aug 04 22:22:13.383558 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 159/323] 10.222.0.109 () {58 vars in 1160 bytes} [Thu Aug 4 22:22:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:13.740532 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e78fc2cd-67ae-4342-9e50-7bd2f64f2358 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:13.741148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e78fc2cd-67ae-4342-9e50-7bd2f64f2358 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:13.747647 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e78fc2cd-67ae-4342-9e50-7bd2f64f2358 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:13.748136 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e78fc2cd-67ae-4342-9e50-7bd2f64f2358 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:13.748572 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e78fc2cd-67ae-4342-9e50-7bd2f64f2358 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:13.749267 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e78fc2cd-67ae-4342-9e50-7bd2f64f2358 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:13.749756 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e78fc2cd-67ae-4342-9e50-7bd2f64f2358 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:13.750214 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e78fc2cd-67ae-4342-9e50-7bd2f64f2358 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:13.938789 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e78fc2cd-67ae-4342-9e50-7bd2f64f2358 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:13.951209 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e78fc2cd-67ae-4342-9e50-7bd2f64f2358 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1506 microversion: 2.1 time: 0.214230 Aug 04 22:22:13.952496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 165/324] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:13 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:14.343073 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7bc4fbd6-8e76-48dc-bca3-9e14e25f5ce3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:14.343680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7bc4fbd6-8e76-48dc-bca3-9e14e25f5ce3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:14.346628 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:14.354001 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7bc4fbd6-8e76-48dc-bca3-9e14e25f5ce3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:14.354491 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7bc4fbd6-8e76-48dc-bca3-9e14e25f5ce3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:14.354928 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7bc4fbd6-8e76-48dc-bca3-9e14e25f5ce3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:14.356480 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7bc4fbd6-8e76-48dc-bca3-9e14e25f5ce3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:14.357038 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7bc4fbd6-8e76-48dc-bca3-9e14e25f5ce3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:14.357348 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7bc4fbd6-8e76-48dc-bca3-9e14e25f5ce3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:14.521531 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7bc4fbd6-8e76-48dc-bca3-9e14e25f5ce3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:14.531814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7bc4fbd6-8e76-48dc-bca3-9e14e25f5ce3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1506 microversion: 2.1 time: 0.192779 Aug 04 22:22:14.549228 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 160/325] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:14 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:14.558284 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-bc173928-6845-4d4f-a6bd-b8bf72be35a3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:14.558941 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-bc173928-6845-4d4f-a6bd-b8bf72be35a3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:14.567397 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bc173928-6845-4d4f-a6bd-b8bf72be35a3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:14.568201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bc173928-6845-4d4f-a6bd-b8bf72be35a3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:14.568388 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bc173928-6845-4d4f-a6bd-b8bf72be35a3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:14.569374 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bc173928-6845-4d4f-a6bd-b8bf72be35a3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:14.570330 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bc173928-6845-4d4f-a6bd-b8bf72be35a3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:14.571134 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bc173928-6845-4d4f-a6bd-b8bf72be35a3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:14.853443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-bc173928-6845-4d4f-a6bd-b8bf72be35a3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:14.862027 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-bc173928-6845-4d4f-a6bd-b8bf72be35a3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1520 microversion: 2.1 time: 0.310773 Aug 04 22:22:14.862848 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 166/326] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:14 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:14.977048 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c9c355f1-a123-4392-9137-c9bfc2ea38f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:14.977936 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c9c355f1-a123-4392-9137-c9bfc2ea38f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:14.987787 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c9c355f1-a123-4392-9137-c9bfc2ea38f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:14.990780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c9c355f1-a123-4392-9137-c9bfc2ea38f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:14.991229 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c9c355f1-a123-4392-9137-c9bfc2ea38f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:14.993228 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c9c355f1-a123-4392-9137-c9bfc2ea38f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:14.994884 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c9c355f1-a123-4392-9137-c9bfc2ea38f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:14.995484 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c9c355f1-a123-4392-9137-c9bfc2ea38f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:15.144157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c9c355f1-a123-4392-9137-c9bfc2ea38f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:15.162667 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c9c355f1-a123-4392-9137-c9bfc2ea38f4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 200 len: 1464 microversion: 2.1 time: 0.189493 Aug 04 22:22:15.163276 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 161/327] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:14 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 1464 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:15.229149 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-6e67368e-d74b-4376-b21c-afd5dbf1b293 req-fccba869-5554-4922-a9fb-b0ddd5f08a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80", "name": "network-vif-deleted", "tag": "4fd18c5e-4c7e-4edd-b112-1062f5099d87"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:22:15.242740 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-6e67368e-d74b-4376-b21c-afd5dbf1b293 req-fccba869-5554-4922-a9fb-b0ddd5f08a50 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:15.243618 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-6e67368e-d74b-4376-b21c-afd5dbf1b293 req-fccba869-5554-4922-a9fb-b0ddd5f08a50 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:15.244077 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-6e67368e-d74b-4376-b21c-afd5dbf1b293 req-fccba869-5554-4922-a9fb-b0ddd5f08a50 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:15.257214 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-6e67368e-d74b-4376-b21c-afd5dbf1b293 req-fccba869-5554-4922-a9fb-b0ddd5f08a50 service nova] Creating event network-vif-deleted:4fd18c5e-4c7e-4edd-b112-1062f5099d87 for instance 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 on hv-cinder-85221 Aug 04 22:22:15.262953 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-6e67368e-d74b-4376-b21c-afd5dbf1b293 req-fccba869-5554-4922-a9fb-b0ddd5f08a50 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038913 Aug 04 22:22:15.263721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 167/328] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:22:16.184103 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-399acc80-ed9c-42bc-b813-4fdfdce87395 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:16.184712 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-399acc80-ed9c-42bc-b813-4fdfdce87395 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:16.190693 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-399acc80-ed9c-42bc-b813-4fdfdce87395 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:16.191185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-399acc80-ed9c-42bc-b813-4fdfdce87395 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:16.191616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-399acc80-ed9c-42bc-b813-4fdfdce87395 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:16.192302 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-399acc80-ed9c-42bc-b813-4fdfdce87395 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:16.192750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-399acc80-ed9c-42bc-b813-4fdfdce87395 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:16.193150 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-399acc80-ed9c-42bc-b813-4fdfdce87395 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:16.206714 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-399acc80-ed9c-42bc-b813-4fdfdce87395 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] HTTP exception thrown: Instance 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 could not be found. Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-399acc80-ed9c-42bc-b813-4fdfdce87395 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Request method failure captured: Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 HTTP/1.1 Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EZ2u-wxbicuP4P_GgELuDpB7UU7-MTacwrtcjy1xH82mLlQHPraXG1eI2DCqr2u2yDy7FT1c7FlVtqLc7CdH0QVr2BPVJHGPfGHGDyMPmpQijd2KUcfiDQUUu1fTdSdFyhn2YGR4qtfvwFkoOwTeLZppaylkaLeJpMd3K22nwjQnfY Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 9017e927b016427aa84b863e0e2a86a4 Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-VolumesActionsTest-1057466123 Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:22:16.208323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:22:16.209855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/9017e927b016427aa84b863e0e2a86a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_9017e927b016427aa84b863e0e2a86a4", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/9017e927b016427aa84b863e0e2a86a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/9017e927b016427aa84b863e0e2a86a4"}]}] Aug 04 22:22:16.209855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-VolumesActionsTest-1057466123 Aug 04 22:22:16.209855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 9017e927b016427aa84b863e0e2a86a4 Aug 04 22:22:16.209855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-VolumesActionsTest-1057466123 Aug 04 22:22:16.209855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-VolumesActionsTest-1057466123-project Aug 04 22:22:16.209855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:22:16.209855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:22:16.209855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 9542521c42b34769a236eb6f268c5358 Aug 04 22:22:16.209855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-VolumesActionsTest-1057466123-project Aug 04 22:22:16.209855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:22:16.209855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 could not be found. Aug 04 22:22:16.209855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80'} Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 could not be found. Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:22:16.210644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 could not be found. Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 could not be found. Aug 04 22:22:16.212094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:22:16.213253 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-399acc80-ed9c-42bc-b813-4fdfdce87395 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Returning 404 to user: Instance 4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:22:16.213253 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-399acc80-ed9c-42bc-b813-4fdfdce87395 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80" status: 404 len: 111 microversion: 2.1 time: 0.029386 Aug 04 22:22:16.213253 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 162/329] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:16 2022] GET /compute/v2.1/servers/4bfa7eb2-6a1b-4e5c-99ed-b94ee2c61b80 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:22:16.315206 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-203649000", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "networks": [{"uuid": "736dc0c9-0e3b-41d7-a414-8334093d65e7"}]}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:22:16.412625 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e0cef5d0-cb96-47ec-928d-2f5d1ee0101d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:22:16.414955 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e0cef5d0-cb96-47ec-928d-2f5d1ee0101d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:16.420747 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0cef5d0-cb96-47ec-928d-2f5d1ee0101d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:16.421230 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0cef5d0-cb96-47ec-928d-2f5d1ee0101d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:16.421711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0cef5d0-cb96-47ec-928d-2f5d1ee0101d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:16.422405 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0cef5d0-cb96-47ec-928d-2f5d1ee0101d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:16.423145 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0cef5d0-cb96-47ec-928d-2f5d1ee0101d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:16.423552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0cef5d0-cb96-47ec-928d-2f5d1ee0101d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:16.449391 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.objects.instance [None req-e0cef5d0-cb96-47ec-928d-2f5d1ee0101d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lazy-loading 'flavor' on Instance uuid 6318eb70-fdcf-4545-b737-61e032221d53 {{(pid=129197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:22:16.560281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e0cef5d0-cb96-47ec-928d-2f5d1ee0101d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "POST /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53/action" status: 200 len: 32 microversion: 2.1 time: 0.151655 Aug 04 22:22:16.560793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 163/330] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:22:16 2022] POST /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 22:22:16.570645 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-03a6dac0-2d4f-494c-8588-909dba3cccbf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:16.571702 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-03a6dac0-2d4f-494c-8588-909dba3cccbf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:16.579729 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-03a6dac0-2d4f-494c-8588-909dba3cccbf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:16.580330 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-03a6dac0-2d4f-494c-8588-909dba3cccbf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:16.580778 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-03a6dac0-2d4f-494c-8588-909dba3cccbf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:16.581542 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-03a6dac0-2d4f-494c-8588-909dba3cccbf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:16.581992 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-03a6dac0-2d4f-494c-8588-909dba3cccbf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:16.582426 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-03a6dac0-2d4f-494c-8588-909dba3cccbf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:16.730476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-03a6dac0-2d4f-494c-8588-909dba3cccbf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:16.739470 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-03a6dac0-2d4f-494c-8588-909dba3cccbf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.173051 Aug 04 22:22:16.740510 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 164/331] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:16 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:17.762078 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bbe9c018-6875-47ed-8d3a-e5054831ba61 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:17.762690 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bbe9c018-6875-47ed-8d3a-e5054831ba61 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:17.769748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bbe9c018-6875-47ed-8d3a-e5054831ba61 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:17.770230 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bbe9c018-6875-47ed-8d3a-e5054831ba61 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:17.770674 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bbe9c018-6875-47ed-8d3a-e5054831ba61 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:17.771421 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bbe9c018-6875-47ed-8d3a-e5054831ba61 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:17.771874 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bbe9c018-6875-47ed-8d3a-e5054831ba61 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:17.772294 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bbe9c018-6875-47ed-8d3a-e5054831ba61 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:17.921795 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bbe9c018-6875-47ed-8d3a-e5054831ba61 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:17.929744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bbe9c018-6875-47ed-8d3a-e5054831ba61 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.171377 Aug 04 22:22:17.930415 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 165/332] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:17 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:18.950122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1a228fd1-8d68-452a-88b2-97c7e550c0ef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:18.950805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1a228fd1-8d68-452a-88b2-97c7e550c0ef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:18.956700 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1a228fd1-8d68-452a-88b2-97c7e550c0ef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:18.957176 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1a228fd1-8d68-452a-88b2-97c7e550c0ef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:18.957639 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1a228fd1-8d68-452a-88b2-97c7e550c0ef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:18.958333 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1a228fd1-8d68-452a-88b2-97c7e550c0ef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:18.958782 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1a228fd1-8d68-452a-88b2-97c7e550c0ef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:18.959205 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1a228fd1-8d68-452a-88b2-97c7e550c0ef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:19.099663 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1a228fd1-8d68-452a-88b2-97c7e550c0ef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:19.107905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1a228fd1-8d68-452a-88b2-97c7e550c0ef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.161539 Aug 04 22:22:19.108588 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 166/333] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:18 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:20.130663 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b010888a-06f1-4502-a70c-a35acd41caf5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:20.131304 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b010888a-06f1-4502-a70c-a35acd41caf5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:20.137190 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b010888a-06f1-4502-a70c-a35acd41caf5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:20.137699 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b010888a-06f1-4502-a70c-a35acd41caf5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:20.138127 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b010888a-06f1-4502-a70c-a35acd41caf5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:20.138803 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b010888a-06f1-4502-a70c-a35acd41caf5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:20.139249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b010888a-06f1-4502-a70c-a35acd41caf5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:20.139672 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b010888a-06f1-4502-a70c-a35acd41caf5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:20.278922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b010888a-06f1-4502-a70c-a35acd41caf5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:20.288035 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b010888a-06f1-4502-a70c-a35acd41caf5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.161116 Aug 04 22:22:20.288791 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 167/334] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:20 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:21.309303 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-de163591-6607-4a5d-abcb-cc8e3881e4d7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:21.309980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-de163591-6607-4a5d-abcb-cc8e3881e4d7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:21.316890 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-de163591-6607-4a5d-abcb-cc8e3881e4d7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:21.318156 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-de163591-6607-4a5d-abcb-cc8e3881e4d7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:21.318672 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-de163591-6607-4a5d-abcb-cc8e3881e4d7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:21.319517 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-de163591-6607-4a5d-abcb-cc8e3881e4d7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:21.319980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-de163591-6607-4a5d-abcb-cc8e3881e4d7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:21.320465 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-de163591-6607-4a5d-abcb-cc8e3881e4d7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:21.465864 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-de163591-6607-4a5d-abcb-cc8e3881e4d7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:21.478006 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-de163591-6607-4a5d-abcb-cc8e3881e4d7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.172435 Aug 04 22:22:21.478617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 168/335] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:21 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:22.499315 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-01631967-3d6e-40c0-8495-0aed27c1a90e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:22.499939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-01631967-3d6e-40c0-8495-0aed27c1a90e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:22.506016 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-01631967-3d6e-40c0-8495-0aed27c1a90e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:22.506508 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-01631967-3d6e-40c0-8495-0aed27c1a90e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:22.506947 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-01631967-3d6e-40c0-8495-0aed27c1a90e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:22.507643 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-01631967-3d6e-40c0-8495-0aed27c1a90e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:22.508103 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-01631967-3d6e-40c0-8495-0aed27c1a90e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:22.508530 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-01631967-3d6e-40c0-8495-0aed27c1a90e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:22.643261 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-01631967-3d6e-40c0-8495-0aed27c1a90e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:22.650705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-01631967-3d6e-40c0-8495-0aed27c1a90e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.155474 Aug 04 22:22:22.651269 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 169/336] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:22 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:23.676465 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0fbd08b7-9481-47c3-a626-d649a987c66c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:23.677088 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0fbd08b7-9481-47c3-a626-d649a987c66c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:23.682889 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0fbd08b7-9481-47c3-a626-d649a987c66c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:23.683446 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0fbd08b7-9481-47c3-a626-d649a987c66c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:23.683881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0fbd08b7-9481-47c3-a626-d649a987c66c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:23.684567 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0fbd08b7-9481-47c3-a626-d649a987c66c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:23.685070 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0fbd08b7-9481-47c3-a626-d649a987c66c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:23.685527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0fbd08b7-9481-47c3-a626-d649a987c66c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:23.688862 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:23.827596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0fbd08b7-9481-47c3-a626-d649a987c66c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:23.837543 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0fbd08b7-9481-47c3-a626-d649a987c66c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.166198 Aug 04 22:22:23.842672 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 170/337] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:23 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:24.858565 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-50df9cde-bbce-4e4c-8a5f-4edab6806714 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:24.859257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-50df9cde-bbce-4e4c-8a5f-4edab6806714 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:24.865746 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50df9cde-bbce-4e4c-8a5f-4edab6806714 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:24.866253 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50df9cde-bbce-4e4c-8a5f-4edab6806714 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:24.866705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50df9cde-bbce-4e4c-8a5f-4edab6806714 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:24.867396 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50df9cde-bbce-4e4c-8a5f-4edab6806714 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:24.867855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50df9cde-bbce-4e4c-8a5f-4edab6806714 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:24.868278 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50df9cde-bbce-4e4c-8a5f-4edab6806714 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:25.137039 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-50df9cde-bbce-4e4c-8a5f-4edab6806714 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:25.144987 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-50df9cde-bbce-4e4c-8a5f-4edab6806714 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.290333 Aug 04 22:22:25.145559 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 171/338] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:24 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:25.249496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=23 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:26.166735 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a6cda195-531b-40ad-82d0-f4451d8b708e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:26.167380 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a6cda195-531b-40ad-82d0-f4451d8b708e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:26.173467 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6cda195-531b-40ad-82d0-f4451d8b708e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:26.173961 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6cda195-531b-40ad-82d0-f4451d8b708e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:26.174403 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6cda195-531b-40ad-82d0-f4451d8b708e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:26.175101 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6cda195-531b-40ad-82d0-f4451d8b708e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:26.175568 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6cda195-531b-40ad-82d0-f4451d8b708e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:26.175999 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6cda195-531b-40ad-82d0-f4451d8b708e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:26.316678 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a6cda195-531b-40ad-82d0-f4451d8b708e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:26.324245 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a6cda195-531b-40ad-82d0-f4451d8b708e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.161438 Aug 04 22:22:26.324875 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:26.325318 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 172/339] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:26 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:26.361298 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.network.neutron [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] validate_networks() for [('736dc0c9-0e3b-41d7-a414-8334093d65e7', None, None, None, None, None)] {{(pid=129196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:22:26.700972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Flavor limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:22:26.701421 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Image limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:22:26.701983 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Flavor pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:22:26.703026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Image pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:22:26.703026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:22:26.712161 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:26.712671 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:26.713109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:26.713861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:26.714313 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:26.714747 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:26.732756 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Getting quotas for project 9017e927b016427aa84b863e0e2a86a4. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:22:26.738080 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Getting quotas for user 9542521c42b34769a236eb6f268c5358 and project 9017e927b016427aa84b863e0e2a86a4. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:22:26.749535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Going to run 1 instances... {{(pid=129196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:22:26.752327 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:22:26.800443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-07717e01-8c25-4c6b-bc73-3ffeccf1a5e9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 10.490851 Aug 04 22:22:26.801190 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 168/340] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:22:16 2022] POST /compute/v2.1/servers => generated 382 bytes in 10492 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:22:26.813263 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3fdf5b9e-1ae2-46ad-8a93-3d51d361f824 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:26.814026 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3fdf5b9e-1ae2-46ad-8a93-3d51d361f824 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:26.869020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3fdf5b9e-1ae2-46ad-8a93-3d51d361f824 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:26.876925 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3fdf5b9e-1ae2-46ad-8a93-3d51d361f824 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1217 microversion: 2.1 time: 0.068377 Aug 04 22:22:26.877519 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 173/341] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:26 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:27.349031 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e67bd892-df6d-47f8-acd6-5583775727b6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:27.349673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e67bd892-df6d-47f8-acd6-5583775727b6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:27.356489 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e67bd892-df6d-47f8-acd6-5583775727b6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:27.356956 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e67bd892-df6d-47f8-acd6-5583775727b6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:27.357384 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e67bd892-df6d-47f8-acd6-5583775727b6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:27.358087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e67bd892-df6d-47f8-acd6-5583775727b6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:27.358533 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e67bd892-df6d-47f8-acd6-5583775727b6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:27.358948 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e67bd892-df6d-47f8-acd6-5583775727b6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:27.484249 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e67bd892-df6d-47f8-acd6-5583775727b6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:27.491794 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e67bd892-df6d-47f8-acd6-5583775727b6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.147076 Aug 04 22:22:27.492389 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 169/342] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:27 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:27.897669 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-75a68645-799e-49c2-8d6b-a8a9413480c4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:27.898212 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-75a68645-799e-49c2-8d6b-a8a9413480c4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:27.904112 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75a68645-799e-49c2-8d6b-a8a9413480c4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:27.904594 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75a68645-799e-49c2-8d6b-a8a9413480c4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:27.905027 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75a68645-799e-49c2-8d6b-a8a9413480c4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:27.905748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75a68645-799e-49c2-8d6b-a8a9413480c4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:27.906627 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75a68645-799e-49c2-8d6b-a8a9413480c4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:27.906915 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75a68645-799e-49c2-8d6b-a8a9413480c4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:27.968517 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-75a68645-799e-49c2-8d6b-a8a9413480c4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:27.975945 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-75a68645-799e-49c2-8d6b-a8a9413480c4 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1221 microversion: 2.1 time: 0.082210 Aug 04 22:22:27.976513 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 174/343] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:27 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:28.514053 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-72262034-b205-4df0-8671-34388b4e60be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:28.514665 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-72262034-b205-4df0-8671-34388b4e60be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:28.521936 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-72262034-b205-4df0-8671-34388b4e60be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:28.522418 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-72262034-b205-4df0-8671-34388b4e60be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:28.522853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-72262034-b205-4df0-8671-34388b4e60be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:28.523545 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-72262034-b205-4df0-8671-34388b4e60be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:28.524005 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-72262034-b205-4df0-8671-34388b4e60be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:28.524430 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-72262034-b205-4df0-8671-34388b4e60be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:28.659524 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-72262034-b205-4df0-8671-34388b4e60be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:28.666984 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-72262034-b205-4df0-8671-34388b4e60be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.156825 Aug 04 22:22:28.667558 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 170/344] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:28 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:28.996989 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bef14700-40ba-4bd4-8749-70348dbaafad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:28.997641 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bef14700-40ba-4bd4-8749-70348dbaafad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:29.003745 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bef14700-40ba-4bd4-8749-70348dbaafad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:29.004230 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bef14700-40ba-4bd4-8749-70348dbaafad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:29.004669 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bef14700-40ba-4bd4-8749-70348dbaafad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:29.005360 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bef14700-40ba-4bd4-8749-70348dbaafad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:29.005840 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bef14700-40ba-4bd4-8749-70348dbaafad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:29.006263 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bef14700-40ba-4bd4-8749-70348dbaafad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:29.067071 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bef14700-40ba-4bd4-8749-70348dbaafad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:29.074467 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bef14700-40ba-4bd4-8749-70348dbaafad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1221 microversion: 2.1 time: 0.081591 Aug 04 22:22:29.075852 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 175/345] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:28 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:29.688354 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f5a601d0-99f4-4c4f-98bc-52dfacfde37a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:29.689001 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f5a601d0-99f4-4c4f-98bc-52dfacfde37a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:29.695302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f5a601d0-99f4-4c4f-98bc-52dfacfde37a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:29.695778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f5a601d0-99f4-4c4f-98bc-52dfacfde37a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:29.696206 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f5a601d0-99f4-4c4f-98bc-52dfacfde37a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:29.696882 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f5a601d0-99f4-4c4f-98bc-52dfacfde37a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:29.697356 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f5a601d0-99f4-4c4f-98bc-52dfacfde37a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:29.697806 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f5a601d0-99f4-4c4f-98bc-52dfacfde37a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:29.824869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f5a601d0-99f4-4c4f-98bc-52dfacfde37a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:29.832838 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f5a601d0-99f4-4c4f-98bc-52dfacfde37a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.148876 Aug 04 22:22:29.833398 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 171/346] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:29 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:30.096424 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-8d5702af-cdbc-43df-a92b-a67b72db6dfa tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:30.097041 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-8d5702af-cdbc-43df-a92b-a67b72db6dfa tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:30.103165 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8d5702af-cdbc-43df-a92b-a67b72db6dfa tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:30.103655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8d5702af-cdbc-43df-a92b-a67b72db6dfa tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:30.104099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8d5702af-cdbc-43df-a92b-a67b72db6dfa tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:30.104799 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8d5702af-cdbc-43df-a92b-a67b72db6dfa tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:30.105260 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8d5702af-cdbc-43df-a92b-a67b72db6dfa tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:30.105715 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8d5702af-cdbc-43df-a92b-a67b72db6dfa tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:30.173285 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8d5702af-cdbc-43df-a92b-a67b72db6dfa tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:30.180608 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-8d5702af-cdbc-43df-a92b-a67b72db6dfa tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1221 microversion: 2.1 time: 0.088197 Aug 04 22:22:30.185680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 176/347] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:30 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:30.855396 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-108c0107-6b25-4acb-9d5c-8e98c933f4db tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:30.856010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-108c0107-6b25-4acb-9d5c-8e98c933f4db tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:30.863898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-108c0107-6b25-4acb-9d5c-8e98c933f4db tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:30.864302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-108c0107-6b25-4acb-9d5c-8e98c933f4db tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:30.864869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-108c0107-6b25-4acb-9d5c-8e98c933f4db tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:30.865654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-108c0107-6b25-4acb-9d5c-8e98c933f4db tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:30.866087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-108c0107-6b25-4acb-9d5c-8e98c933f4db tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:30.866587 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-108c0107-6b25-4acb-9d5c-8e98c933f4db tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:31.004117 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-108c0107-6b25-4acb-9d5c-8e98c933f4db tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:31.011644 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-108c0107-6b25-4acb-9d5c-8e98c933f4db tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.160626 Aug 04 22:22:31.012200 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 172/348] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:30 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:31.205582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1891c6b2-541b-4f54-8f1f-54d4d992e4cb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:31.206200 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1891c6b2-541b-4f54-8f1f-54d4d992e4cb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:31.212077 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1891c6b2-541b-4f54-8f1f-54d4d992e4cb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:31.212560 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1891c6b2-541b-4f54-8f1f-54d4d992e4cb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:31.212992 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1891c6b2-541b-4f54-8f1f-54d4d992e4cb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:31.213750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1891c6b2-541b-4f54-8f1f-54d4d992e4cb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:31.214206 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1891c6b2-541b-4f54-8f1f-54d4d992e4cb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:31.214628 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1891c6b2-541b-4f54-8f1f-54d4d992e4cb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:31.276644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1891c6b2-541b-4f54-8f1f-54d4d992e4cb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:31.284012 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1891c6b2-541b-4f54-8f1f-54d4d992e4cb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1221 microversion: 2.1 time: 0.083596 Aug 04 22:22:31.284567 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 177/349] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:31 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:32.033901 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-bfa6380b-f508-426b-afd2-6c556bd339f5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:32.034634 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-bfa6380b-f508-426b-afd2-6c556bd339f5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:32.041611 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bfa6380b-f508-426b-afd2-6c556bd339f5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:32.042131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bfa6380b-f508-426b-afd2-6c556bd339f5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:32.042567 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bfa6380b-f508-426b-afd2-6c556bd339f5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:32.043261 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bfa6380b-f508-426b-afd2-6c556bd339f5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:32.043717 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bfa6380b-f508-426b-afd2-6c556bd339f5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:32.044143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bfa6380b-f508-426b-afd2-6c556bd339f5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:32.176427 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-bfa6380b-f508-426b-afd2-6c556bd339f5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:32.184538 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-bfa6380b-f508-426b-afd2-6c556bd339f5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.155468 Aug 04 22:22:32.185285 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 173/350] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:32 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:32.306662 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d94a3315-2cea-484c-b37e-c56227d6a72c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:32.308306 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d94a3315-2cea-484c-b37e-c56227d6a72c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:32.315700 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d94a3315-2cea-484c-b37e-c56227d6a72c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:32.316194 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d94a3315-2cea-484c-b37e-c56227d6a72c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:32.316720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d94a3315-2cea-484c-b37e-c56227d6a72c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:32.317353 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d94a3315-2cea-484c-b37e-c56227d6a72c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:32.326350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d94a3315-2cea-484c-b37e-c56227d6a72c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:32.326350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d94a3315-2cea-484c-b37e-c56227d6a72c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:32.381887 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d94a3315-2cea-484c-b37e-c56227d6a72c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:32.389449 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d94a3315-2cea-484c-b37e-c56227d6a72c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1221 microversion: 2.1 time: 0.088109 Aug 04 22:22:32.390181 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 178/351] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:32 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:33.206468 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-080b8df6-d883-4cc4-97f1-3c6aed82acdf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:33.207072 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-080b8df6-d883-4cc4-97f1-3c6aed82acdf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:33.213715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-080b8df6-d883-4cc4-97f1-3c6aed82acdf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:33.214194 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-080b8df6-d883-4cc4-97f1-3c6aed82acdf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:33.214622 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-080b8df6-d883-4cc4-97f1-3c6aed82acdf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:33.215316 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-080b8df6-d883-4cc4-97f1-3c6aed82acdf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:33.215747 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-080b8df6-d883-4cc4-97f1-3c6aed82acdf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:33.216165 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-080b8df6-d883-4cc4-97f1-3c6aed82acdf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:33.409900 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a5867ca5-7f8a-4b66-8578-1fbd4a647368 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:33.411075 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a5867ca5-7f8a-4b66-8578-1fbd4a647368 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:33.418582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a5867ca5-7f8a-4b66-8578-1fbd4a647368 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:33.419497 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a5867ca5-7f8a-4b66-8578-1fbd4a647368 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:33.419992 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a5867ca5-7f8a-4b66-8578-1fbd4a647368 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:33.420810 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a5867ca5-7f8a-4b66-8578-1fbd4a647368 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:33.421990 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a5867ca5-7f8a-4b66-8578-1fbd4a647368 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:33.422921 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a5867ca5-7f8a-4b66-8578-1fbd4a647368 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:33.457214 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-080b8df6-d883-4cc4-97f1-3c6aed82acdf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:33.467537 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-080b8df6-d883-4cc4-97f1-3c6aed82acdf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.265416 Aug 04 22:22:33.468720 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 174/352] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:33 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:33.553302 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a5867ca5-7f8a-4b66-8578-1fbd4a647368 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:33.564041 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a5867ca5-7f8a-4b66-8578-1fbd4a647368 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1277 microversion: 2.1 time: 0.158758 Aug 04 22:22:33.578654 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 179/353] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:33 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:34.489947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-fef53fd0-6707-4a9d-a30a-b417c6a75339 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:34.490618 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-fef53fd0-6707-4a9d-a30a-b417c6a75339 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:34.497191 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fef53fd0-6707-4a9d-a30a-b417c6a75339 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:34.497713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fef53fd0-6707-4a9d-a30a-b417c6a75339 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:34.498150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fef53fd0-6707-4a9d-a30a-b417c6a75339 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:34.498857 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fef53fd0-6707-4a9d-a30a-b417c6a75339 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:34.500048 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fef53fd0-6707-4a9d-a30a-b417c6a75339 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:34.501109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fef53fd0-6707-4a9d-a30a-b417c6a75339 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:34.588670 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c40e53f6-69d4-418e-b6bf-17fbd47c09f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:34.589809 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c40e53f6-69d4-418e-b6bf-17fbd47c09f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:34.595957 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c40e53f6-69d4-418e-b6bf-17fbd47c09f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:34.596900 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c40e53f6-69d4-418e-b6bf-17fbd47c09f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:34.597529 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c40e53f6-69d4-418e-b6bf-17fbd47c09f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:34.599511 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c40e53f6-69d4-418e-b6bf-17fbd47c09f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:34.600417 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c40e53f6-69d4-418e-b6bf-17fbd47c09f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:34.601071 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c40e53f6-69d4-418e-b6bf-17fbd47c09f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:34.643988 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-fef53fd0-6707-4a9d-a30a-b417c6a75339 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:34.652366 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-fef53fd0-6707-4a9d-a30a-b417c6a75339 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.166205 Aug 04 22:22:34.653119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 175/354] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:34 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:34.838236 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c40e53f6-69d4-418e-b6bf-17fbd47c09f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:34.846507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c40e53f6-69d4-418e-b6bf-17fbd47c09f9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.261895 Aug 04 22:22:34.847314 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 180/355] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:34 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:35.118282 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-31f1711d-af00-42ab-9852-462a8bc62ea4 req-1b67b019-1ba9-48ec-9316-2775dddc076d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe4f98c-ef1c-4ff7-886c-aa5f6fba4060", "tag": "9b827747-2bc5-47da-a103-19ea8f8e7429"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:22:35.128342 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-31f1711d-af00-42ab-9852-462a8bc62ea4 req-1b67b019-1ba9-48ec-9316-2775dddc076d service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:35.129048 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-31f1711d-af00-42ab-9852-462a8bc62ea4 req-1b67b019-1ba9-48ec-9316-2775dddc076d service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:35.129701 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-31f1711d-af00-42ab-9852-462a8bc62ea4 req-1b67b019-1ba9-48ec-9316-2775dddc076d service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:35.153623 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-31f1711d-af00-42ab-9852-462a8bc62ea4 req-1b67b019-1ba9-48ec-9316-2775dddc076d service nova] Creating event network-changed:9b827747-2bc5-47da-a103-19ea8f8e7429 for instance abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 on hv-cinder-85221 Aug 04 22:22:35.161492 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-31f1711d-af00-42ab-9852-462a8bc62ea4 req-1b67b019-1ba9-48ec-9316-2775dddc076d service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047436 Aug 04 22:22:35.162466 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 176/356] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:22:35.674780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3f11ae90-7500-4b8f-bc0a-a9ffba361d09 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:35.675539 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3f11ae90-7500-4b8f-bc0a-a9ffba361d09 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:35.682265 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3f11ae90-7500-4b8f-bc0a-a9ffba361d09 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:35.682755 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3f11ae90-7500-4b8f-bc0a-a9ffba361d09 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:35.683442 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3f11ae90-7500-4b8f-bc0a-a9ffba361d09 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:35.684002 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3f11ae90-7500-4b8f-bc0a-a9ffba361d09 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:35.684477 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3f11ae90-7500-4b8f-bc0a-a9ffba361d09 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:35.684981 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3f11ae90-7500-4b8f-bc0a-a9ffba361d09 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:35.869028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-27c63548-4d5d-497c-bfe8-8b781fcb662f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:35.869853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-27c63548-4d5d-497c-bfe8-8b781fcb662f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:35.876989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-27c63548-4d5d-497c-bfe8-8b781fcb662f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:35.877591 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-27c63548-4d5d-497c-bfe8-8b781fcb662f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:35.878028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-27c63548-4d5d-497c-bfe8-8b781fcb662f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:35.878718 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-27c63548-4d5d-497c-bfe8-8b781fcb662f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:35.879163 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-27c63548-4d5d-497c-bfe8-8b781fcb662f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:35.879628 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-27c63548-4d5d-497c-bfe8-8b781fcb662f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:35.920591 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3f11ae90-7500-4b8f-bc0a-a9ffba361d09 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:35.929037 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3f11ae90-7500-4b8f-bc0a-a9ffba361d09 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.258466 Aug 04 22:22:35.929821 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 181/357] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:35 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:36.028502 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-27c63548-4d5d-497c-bfe8-8b781fcb662f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:36.036757 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-27c63548-4d5d-497c-bfe8-8b781fcb662f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.172371 Aug 04 22:22:36.037449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 177/358] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:35 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:36.952119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-88cb965d-6661-4afa-a940-aa1c14427850 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:36.953381 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-88cb965d-6661-4afa-a940-aa1c14427850 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:36.955315 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:36.961368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88cb965d-6661-4afa-a940-aa1c14427850 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:36.961970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88cb965d-6661-4afa-a940-aa1c14427850 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:36.962444 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88cb965d-6661-4afa-a940-aa1c14427850 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:36.963181 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88cb965d-6661-4afa-a940-aa1c14427850 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:36.963645 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88cb965d-6661-4afa-a940-aa1c14427850 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:36.964074 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88cb965d-6661-4afa-a940-aa1c14427850 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:37.059975 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1041050d-ecc6-4e8a-998b-ba479d0acf3b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:37.060799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1041050d-ecc6-4e8a-998b-ba479d0acf3b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:37.064091 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:37.065301 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=6 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:37.072642 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1041050d-ecc6-4e8a-998b-ba479d0acf3b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:37.073331 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1041050d-ecc6-4e8a-998b-ba479d0acf3b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:37.073838 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1041050d-ecc6-4e8a-998b-ba479d0acf3b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:37.074703 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1041050d-ecc6-4e8a-998b-ba479d0acf3b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:37.075317 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1041050d-ecc6-4e8a-998b-ba479d0acf3b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:37.075739 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1041050d-ecc6-4e8a-998b-ba479d0acf3b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:37.119980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-88cb965d-6661-4afa-a940-aa1c14427850 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:37.129167 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-88cb965d-6661-4afa-a940-aa1c14427850 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.180656 Aug 04 22:22:37.129990 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 182/359] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:36 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:37.261237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1041050d-ecc6-4e8a-998b-ba479d0acf3b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:37.289117 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1041050d-ecc6-4e8a-998b-ba479d0acf3b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.233059 Aug 04 22:22:37.296181 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 178/360] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:37 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:38.150948 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-100f1f25-7452-427b-85f1-a3682eac15f3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:38.151688 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-100f1f25-7452-427b-85f1-a3682eac15f3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:38.161392 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-100f1f25-7452-427b-85f1-a3682eac15f3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:38.162169 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-100f1f25-7452-427b-85f1-a3682eac15f3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:38.162618 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-100f1f25-7452-427b-85f1-a3682eac15f3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:38.163507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-100f1f25-7452-427b-85f1-a3682eac15f3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:38.163976 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-100f1f25-7452-427b-85f1-a3682eac15f3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:38.164407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-100f1f25-7452-427b-85f1-a3682eac15f3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:38.320613 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-951076b7-4f3a-4ce3-9dff-208fbc30ee30 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:38.321722 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-951076b7-4f3a-4ce3-9dff-208fbc30ee30 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:38.329316 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-951076b7-4f3a-4ce3-9dff-208fbc30ee30 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:38.329867 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-951076b7-4f3a-4ce3-9dff-208fbc30ee30 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:38.330293 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-951076b7-4f3a-4ce3-9dff-208fbc30ee30 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:38.331188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-951076b7-4f3a-4ce3-9dff-208fbc30ee30 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:38.331821 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-951076b7-4f3a-4ce3-9dff-208fbc30ee30 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:38.332243 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-951076b7-4f3a-4ce3-9dff-208fbc30ee30 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:38.580937 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-100f1f25-7452-427b-85f1-a3682eac15f3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:38.590236 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-100f1f25-7452-427b-85f1-a3682eac15f3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.443103 Aug 04 22:22:38.591086 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 183/361] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:38 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:38.742479 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-951076b7-4f3a-4ce3-9dff-208fbc30ee30 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:38.750983 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-951076b7-4f3a-4ce3-9dff-208fbc30ee30 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.435046 Aug 04 22:22:38.751548 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 179/362] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:38 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:39.613320 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-cbdde842-da36-46dd-999a-c8a5b911d62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:39.614361 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-cbdde842-da36-46dd-999a-c8a5b911d62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:39.622297 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbdde842-da36-46dd-999a-c8a5b911d62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:39.622876 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbdde842-da36-46dd-999a-c8a5b911d62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:39.623315 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbdde842-da36-46dd-999a-c8a5b911d62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:39.624358 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbdde842-da36-46dd-999a-c8a5b911d62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:39.625042 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbdde842-da36-46dd-999a-c8a5b911d62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:39.625503 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbdde842-da36-46dd-999a-c8a5b911d62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:39.762845 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-cbdde842-da36-46dd-999a-c8a5b911d62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:39.771570 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-cbdde842-da36-46dd-999a-c8a5b911d62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.164123 Aug 04 22:22:39.772136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 184/363] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:39 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:39.772937 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e0719bec-1410-432c-99df-098d7327e268 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:39.774079 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e0719bec-1410-432c-99df-098d7327e268 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:39.781815 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e0719bec-1410-432c-99df-098d7327e268 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:39.782335 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e0719bec-1410-432c-99df-098d7327e268 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:39.782772 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e0719bec-1410-432c-99df-098d7327e268 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:39.783466 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e0719bec-1410-432c-99df-098d7327e268 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:39.783918 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e0719bec-1410-432c-99df-098d7327e268 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:39.784357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e0719bec-1410-432c-99df-098d7327e268 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:39.913258 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e0719bec-1410-432c-99df-098d7327e268 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:39.920899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e0719bec-1410-432c-99df-098d7327e268 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.151657 Aug 04 22:22:39.921779 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 180/364] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:39 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:40.794470 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-95c5d036-33a6-4542-be67-38fc86d06d85 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:40.795215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-95c5d036-33a6-4542-be67-38fc86d06d85 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:40.802308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-95c5d036-33a6-4542-be67-38fc86d06d85 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:40.802728 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-95c5d036-33a6-4542-be67-38fc86d06d85 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:40.803604 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-95c5d036-33a6-4542-be67-38fc86d06d85 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:40.804360 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-95c5d036-33a6-4542-be67-38fc86d06d85 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:40.804853 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-95c5d036-33a6-4542-be67-38fc86d06d85 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:40.805313 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-95c5d036-33a6-4542-be67-38fc86d06d85 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:40.941019 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-95c5d036-33a6-4542-be67-38fc86d06d85 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:40.942621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a63b77c8-a6ae-431a-b4b0-f555cb37438b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:40.943237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a63b77c8-a6ae-431a-b4b0-f555cb37438b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:40.948494 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-95c5d036-33a6-4542-be67-38fc86d06d85 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.158028 Aug 04 22:22:40.949059 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 185/365] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:40 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:40.949564 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a63b77c8-a6ae-431a-b4b0-f555cb37438b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:40.950047 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a63b77c8-a6ae-431a-b4b0-f555cb37438b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:40.950478 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a63b77c8-a6ae-431a-b4b0-f555cb37438b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:40.951197 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a63b77c8-a6ae-431a-b4b0-f555cb37438b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:40.951649 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a63b77c8-a6ae-431a-b4b0-f555cb37438b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:40.952869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a63b77c8-a6ae-431a-b4b0-f555cb37438b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:41.088479 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a63b77c8-a6ae-431a-b4b0-f555cb37438b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:41.096805 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a63b77c8-a6ae-431a-b4b0-f555cb37438b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.158042 Aug 04 22:22:41.097361 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 181/366] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:40 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:41.971045 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4fa434e0-154a-4a14-8b00-477b0a7225c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:41.972206 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4fa434e0-154a-4a14-8b00-477b0a7225c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:41.980286 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4fa434e0-154a-4a14-8b00-477b0a7225c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:41.981019 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4fa434e0-154a-4a14-8b00-477b0a7225c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:41.981843 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4fa434e0-154a-4a14-8b00-477b0a7225c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:41.982661 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4fa434e0-154a-4a14-8b00-477b0a7225c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:41.983656 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4fa434e0-154a-4a14-8b00-477b0a7225c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:41.984205 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4fa434e0-154a-4a14-8b00-477b0a7225c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:42.118065 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-eb100f5a-8ec4-430e-8624-1cabe330e16b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:42.118685 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-eb100f5a-8ec4-430e-8624-1cabe330e16b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:42.126365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eb100f5a-8ec4-430e-8624-1cabe330e16b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:42.126854 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eb100f5a-8ec4-430e-8624-1cabe330e16b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:42.127292 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eb100f5a-8ec4-430e-8624-1cabe330e16b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:42.127992 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eb100f5a-8ec4-430e-8624-1cabe330e16b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:42.128444 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eb100f5a-8ec4-430e-8624-1cabe330e16b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:42.128864 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eb100f5a-8ec4-430e-8624-1cabe330e16b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:42.137995 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4fa434e0-154a-4a14-8b00-477b0a7225c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:42.147238 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4fa434e0-154a-4a14-8b00-477b0a7225c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.181077 Aug 04 22:22:42.147814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 186/367] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:41 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:42.268377 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-eb100f5a-8ec4-430e-8624-1cabe330e16b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:42.282132 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-eb100f5a-8ec4-430e-8624-1cabe330e16b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.167578 Aug 04 22:22:42.282724 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 182/368] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:42 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:43.168530 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d781af05-5187-48ec-8cf1-594675ea10e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:43.169070 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d781af05-5187-48ec-8cf1-594675ea10e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:43.176026 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d781af05-5187-48ec-8cf1-594675ea10e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:43.176519 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d781af05-5187-48ec-8cf1-594675ea10e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:43.176961 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d781af05-5187-48ec-8cf1-594675ea10e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:43.177754 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d781af05-5187-48ec-8cf1-594675ea10e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:43.178215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d781af05-5187-48ec-8cf1-594675ea10e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:43.178646 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d781af05-5187-48ec-8cf1-594675ea10e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:43.303216 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-dfc21d69-e0aa-400e-8584-aca39b0fbf13 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:43.303916 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-dfc21d69-e0aa-400e-8584-aca39b0fbf13 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:43.310629 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dfc21d69-e0aa-400e-8584-aca39b0fbf13 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:43.311918 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dfc21d69-e0aa-400e-8584-aca39b0fbf13 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:43.312554 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d781af05-5187-48ec-8cf1-594675ea10e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:43.312693 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dfc21d69-e0aa-400e-8584-aca39b0fbf13 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:43.313517 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dfc21d69-e0aa-400e-8584-aca39b0fbf13 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:43.314049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dfc21d69-e0aa-400e-8584-aca39b0fbf13 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:43.314665 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dfc21d69-e0aa-400e-8584-aca39b0fbf13 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:43.315109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=100 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:43.328581 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d781af05-5187-48ec-8cf1-594675ea10e5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.163832 Aug 04 22:22:43.329170 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 187/369] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:43 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:43.451820 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-dfc21d69-e0aa-400e-8584-aca39b0fbf13 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:43.459188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-dfc21d69-e0aa-400e-8584-aca39b0fbf13 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.159885 Aug 04 22:22:43.459745 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 183/370] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:43 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:44.349297 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9a8cea51-2fa1-4cc6-b6d8-e0cfc393e46f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:44.349939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-9a8cea51-2fa1-4cc6-b6d8-e0cfc393e46f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:44.355890 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9a8cea51-2fa1-4cc6-b6d8-e0cfc393e46f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:44.356375 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9a8cea51-2fa1-4cc6-b6d8-e0cfc393e46f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:44.356817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9a8cea51-2fa1-4cc6-b6d8-e0cfc393e46f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:44.357529 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9a8cea51-2fa1-4cc6-b6d8-e0cfc393e46f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:44.358664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9a8cea51-2fa1-4cc6-b6d8-e0cfc393e46f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:44.359101 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9a8cea51-2fa1-4cc6-b6d8-e0cfc393e46f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:44.481132 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-57a4054e-dea0-4375-8cd2-3ddac2bec2e0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:44.481918 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-57a4054e-dea0-4375-8cd2-3ddac2bec2e0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:44.489282 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57a4054e-dea0-4375-8cd2-3ddac2bec2e0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:44.489877 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57a4054e-dea0-4375-8cd2-3ddac2bec2e0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:44.490306 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57a4054e-dea0-4375-8cd2-3ddac2bec2e0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:44.491000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57a4054e-dea0-4375-8cd2-3ddac2bec2e0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:44.491450 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57a4054e-dea0-4375-8cd2-3ddac2bec2e0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:44.491905 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57a4054e-dea0-4375-8cd2-3ddac2bec2e0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:44.494606 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9a8cea51-2fa1-4cc6-b6d8-e0cfc393e46f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:44.503329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9a8cea51-2fa1-4cc6-b6d8-e0cfc393e46f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.157813 Aug 04 22:22:44.503999 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 188/371] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:44 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:44.624093 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-57a4054e-dea0-4375-8cd2-3ddac2bec2e0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:44.631320 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-57a4054e-dea0-4375-8cd2-3ddac2bec2e0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.155596 Aug 04 22:22:44.631878 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 184/372] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:44 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:45.524252 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-21301c6b-a03a-4007-b8e4-eff3854ec665 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:45.524893 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-21301c6b-a03a-4007-b8e4-eff3854ec665 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:45.526825 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=60 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:45.533362 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-21301c6b-a03a-4007-b8e4-eff3854ec665 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:45.533879 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-21301c6b-a03a-4007-b8e4-eff3854ec665 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:45.534319 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-21301c6b-a03a-4007-b8e4-eff3854ec665 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:45.535361 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-21301c6b-a03a-4007-b8e4-eff3854ec665 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:45.536021 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-21301c6b-a03a-4007-b8e4-eff3854ec665 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:45.536743 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-21301c6b-a03a-4007-b8e4-eff3854ec665 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:45.651514 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6454cac5-4fb8-45dd-8b8b-5351485e0684 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:45.652131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6454cac5-4fb8-45dd-8b8b-5351485e0684 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:45.659349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6454cac5-4fb8-45dd-8b8b-5351485e0684 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:45.659837 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6454cac5-4fb8-45dd-8b8b-5351485e0684 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:45.660283 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6454cac5-4fb8-45dd-8b8b-5351485e0684 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:45.660989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6454cac5-4fb8-45dd-8b8b-5351485e0684 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:45.661467 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6454cac5-4fb8-45dd-8b8b-5351485e0684 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:45.661900 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6454cac5-4fb8-45dd-8b8b-5351485e0684 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:45.677189 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-21301c6b-a03a-4007-b8e4-eff3854ec665 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:45.684661 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-21301c6b-a03a-4007-b8e4-eff3854ec665 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.164332 Aug 04 22:22:45.685262 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 189/373] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:45 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:45.794143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6454cac5-4fb8-45dd-8b8b-5351485e0684 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:45.799304 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:45.805393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6454cac5-4fb8-45dd-8b8b-5351485e0684 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.157591 Aug 04 22:22:45.806112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 185/374] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:45 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:46.706517 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1aac8f14-5cf3-4fc7-bf42-2fbd3f1997fe tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:46.707117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1aac8f14-5cf3-4fc7-bf42-2fbd3f1997fe tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:46.713121 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1aac8f14-5cf3-4fc7-bf42-2fbd3f1997fe tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:46.713499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1aac8f14-5cf3-4fc7-bf42-2fbd3f1997fe tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:46.713942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1aac8f14-5cf3-4fc7-bf42-2fbd3f1997fe tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:46.714730 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1aac8f14-5cf3-4fc7-bf42-2fbd3f1997fe tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:46.715270 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1aac8f14-5cf3-4fc7-bf42-2fbd3f1997fe tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:46.715794 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1aac8f14-5cf3-4fc7-bf42-2fbd3f1997fe tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:46.826153 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b2f78af2-cdfd-4f9d-94d4-996e68bbfc07 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:46.827333 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b2f78af2-cdfd-4f9d-94d4-996e68bbfc07 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:46.833601 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b2f78af2-cdfd-4f9d-94d4-996e68bbfc07 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:46.834080 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b2f78af2-cdfd-4f9d-94d4-996e68bbfc07 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:46.834501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b2f78af2-cdfd-4f9d-94d4-996e68bbfc07 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:46.835364 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b2f78af2-cdfd-4f9d-94d4-996e68bbfc07 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:46.835815 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b2f78af2-cdfd-4f9d-94d4-996e68bbfc07 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:46.836230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b2f78af2-cdfd-4f9d-94d4-996e68bbfc07 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:46.850074 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1aac8f14-5cf3-4fc7-bf42-2fbd3f1997fe tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:46.858516 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1aac8f14-5cf3-4fc7-bf42-2fbd3f1997fe tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.156656 Aug 04 22:22:46.859502 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 190/375] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:46 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:46.975303 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b2f78af2-cdfd-4f9d-94d4-996e68bbfc07 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:46.982665 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b2f78af2-cdfd-4f9d-94d4-996e68bbfc07 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.160560 Aug 04 22:22:46.983272 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 186/376] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:46 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:47.880817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2e0f836c-19ac-4e3b-98d3-7f04da4dfdfd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:47.881507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2e0f836c-19ac-4e3b-98d3-7f04da4dfdfd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:47.887835 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e0f836c-19ac-4e3b-98d3-7f04da4dfdfd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:47.888317 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e0f836c-19ac-4e3b-98d3-7f04da4dfdfd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:47.888748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e0f836c-19ac-4e3b-98d3-7f04da4dfdfd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:47.890012 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e0f836c-19ac-4e3b-98d3-7f04da4dfdfd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:47.890460 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e0f836c-19ac-4e3b-98d3-7f04da4dfdfd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:47.890885 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e0f836c-19ac-4e3b-98d3-7f04da4dfdfd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:48.003423 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b495348d-15f7-40b6-a640-13aa6a4ecd6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:48.004042 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b495348d-15f7-40b6-a640-13aa6a4ecd6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:48.010544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b495348d-15f7-40b6-a640-13aa6a4ecd6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:48.011029 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b495348d-15f7-40b6-a640-13aa6a4ecd6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:48.011467 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b495348d-15f7-40b6-a640-13aa6a4ecd6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:48.012166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b495348d-15f7-40b6-a640-13aa6a4ecd6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:48.012656 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b495348d-15f7-40b6-a640-13aa6a4ecd6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:48.013093 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b495348d-15f7-40b6-a640-13aa6a4ecd6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:48.021064 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2e0f836c-19ac-4e3b-98d3-7f04da4dfdfd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:48.028498 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2e0f836c-19ac-4e3b-98d3-7f04da4dfdfd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.151435 Aug 04 22:22:48.029065 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 191/377] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:47 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:48.144964 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b495348d-15f7-40b6-a640-13aa6a4ecd6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:48.152281 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b495348d-15f7-40b6-a640-13aa6a4ecd6b tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.152840 Aug 04 22:22:48.152836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 187/378] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:47 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:49.050226 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-85e7ce50-c00e-4cf1-9224-72cfe0999db0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:49.050840 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-85e7ce50-c00e-4cf1-9224-72cfe0999db0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:49.056767 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-85e7ce50-c00e-4cf1-9224-72cfe0999db0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:49.057250 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-85e7ce50-c00e-4cf1-9224-72cfe0999db0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:49.057723 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-85e7ce50-c00e-4cf1-9224-72cfe0999db0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:49.058420 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-85e7ce50-c00e-4cf1-9224-72cfe0999db0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:49.058873 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-85e7ce50-c00e-4cf1-9224-72cfe0999db0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:49.059322 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-85e7ce50-c00e-4cf1-9224-72cfe0999db0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:49.172307 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-060e73c4-fd6c-4501-b233-a5621b446333 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:49.172909 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-060e73c4-fd6c-4501-b233-a5621b446333 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:49.178976 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-060e73c4-fd6c-4501-b233-a5621b446333 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:49.179458 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-060e73c4-fd6c-4501-b233-a5621b446333 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:49.179887 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-060e73c4-fd6c-4501-b233-a5621b446333 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:49.180572 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-060e73c4-fd6c-4501-b233-a5621b446333 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:49.181018 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-060e73c4-fd6c-4501-b233-a5621b446333 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:49.181459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-060e73c4-fd6c-4501-b233-a5621b446333 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:49.195108 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-85e7ce50-c00e-4cf1-9224-72cfe0999db0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:49.203218 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-85e7ce50-c00e-4cf1-9224-72cfe0999db0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.156909 Aug 04 22:22:49.203791 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 192/379] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:49 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:49.318329 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-060e73c4-fd6c-4501-b233-a5621b446333 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:49.325720 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-060e73c4-fd6c-4501-b233-a5621b446333 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.157258 Aug 04 22:22:49.326321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 188/380] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:49 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:50.224438 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c04f37f4-6fe9-42c6-b576-56289eb77a32 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:50.225092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c04f37f4-6fe9-42c6-b576-56289eb77a32 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:50.231464 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c04f37f4-6fe9-42c6-b576-56289eb77a32 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:50.231946 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c04f37f4-6fe9-42c6-b576-56289eb77a32 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:50.232431 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c04f37f4-6fe9-42c6-b576-56289eb77a32 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:50.233114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c04f37f4-6fe9-42c6-b576-56289eb77a32 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:50.233601 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c04f37f4-6fe9-42c6-b576-56289eb77a32 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:50.234021 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c04f37f4-6fe9-42c6-b576-56289eb77a32 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:50.346737 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e680d61c-8933-4b03-bcbd-f18599342ad5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:50.347324 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e680d61c-8933-4b03-bcbd-f18599342ad5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:50.353625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e680d61c-8933-4b03-bcbd-f18599342ad5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:50.354103 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e680d61c-8933-4b03-bcbd-f18599342ad5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:50.354534 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e680d61c-8933-4b03-bcbd-f18599342ad5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:50.355229 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e680d61c-8933-4b03-bcbd-f18599342ad5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:50.355671 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e680d61c-8933-4b03-bcbd-f18599342ad5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:50.356085 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e680d61c-8933-4b03-bcbd-f18599342ad5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:50.365534 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c04f37f4-6fe9-42c6-b576-56289eb77a32 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:50.374143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c04f37f4-6fe9-42c6-b576-56289eb77a32 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.152720 Aug 04 22:22:50.374716 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 193/381] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:50 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:50.492123 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e680d61c-8933-4b03-bcbd-f18599342ad5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:50.499889 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e680d61c-8933-4b03-bcbd-f18599342ad5 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.157945 Aug 04 22:22:50.500456 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 189/382] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:50 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:51.394537 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d8d44703-eea5-424e-a196-f1f6271006dc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:51.395159 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d8d44703-eea5-424e-a196-f1f6271006dc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:51.400990 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8d44703-eea5-424e-a196-f1f6271006dc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:51.401515 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8d44703-eea5-424e-a196-f1f6271006dc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:51.401961 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8d44703-eea5-424e-a196-f1f6271006dc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:51.402705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8d44703-eea5-424e-a196-f1f6271006dc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:51.403166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8d44703-eea5-424e-a196-f1f6271006dc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:51.403595 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8d44703-eea5-424e-a196-f1f6271006dc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:51.521339 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4c05320a-4aab-4ba7-bd37-40eb02f42765 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:51.522112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4c05320a-4aab-4ba7-bd37-40eb02f42765 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:51.529137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c05320a-4aab-4ba7-bd37-40eb02f42765 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:51.530154 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c05320a-4aab-4ba7-bd37-40eb02f42765 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:51.530690 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c05320a-4aab-4ba7-bd37-40eb02f42765 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:51.531522 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c05320a-4aab-4ba7-bd37-40eb02f42765 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:51.532078 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c05320a-4aab-4ba7-bd37-40eb02f42765 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:51.532682 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c05320a-4aab-4ba7-bd37-40eb02f42765 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:51.550231 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d8d44703-eea5-424e-a196-f1f6271006dc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:51.559337 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d8d44703-eea5-424e-a196-f1f6271006dc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.168386 Aug 04 22:22:51.560215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 194/383] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:51 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:51.673318 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4c05320a-4aab-4ba7-bd37-40eb02f42765 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:51.680906 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4c05320a-4aab-4ba7-bd37-40eb02f42765 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.164103 Aug 04 22:22:51.681494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 190/384] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:51 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:52.582631 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-27ec31c9-4f26-43db-9db7-bac11b45b73b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:52.583250 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-27ec31c9-4f26-43db-9db7-bac11b45b73b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:52.589272 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-27ec31c9-4f26-43db-9db7-bac11b45b73b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:52.589794 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-27ec31c9-4f26-43db-9db7-bac11b45b73b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:52.590237 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-27ec31c9-4f26-43db-9db7-bac11b45b73b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:52.590932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-27ec31c9-4f26-43db-9db7-bac11b45b73b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:52.591393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-27ec31c9-4f26-43db-9db7-bac11b45b73b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:52.592291 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-27ec31c9-4f26-43db-9db7-bac11b45b73b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:52.703011 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c8a13cd2-005c-439c-b3a5-58197901313d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:52.703620 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c8a13cd2-005c-439c-b3a5-58197901313d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:52.710005 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c8a13cd2-005c-439c-b3a5-58197901313d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:52.710488 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c8a13cd2-005c-439c-b3a5-58197901313d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:52.710923 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c8a13cd2-005c-439c-b3a5-58197901313d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:52.711617 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c8a13cd2-005c-439c-b3a5-58197901313d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:52.712104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c8a13cd2-005c-439c-b3a5-58197901313d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:52.712534 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c8a13cd2-005c-439c-b3a5-58197901313d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:52.739507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-27ec31c9-4f26-43db-9db7-bac11b45b73b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:52.747796 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-27ec31c9-4f26-43db-9db7-bac11b45b73b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.169004 Aug 04 22:22:52.748701 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 195/385] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:52 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:52.849063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c8a13cd2-005c-439c-b3a5-58197901313d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:52.856622 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c8a13cd2-005c-439c-b3a5-58197901313d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.157468 Aug 04 22:22:52.858080 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 191/386] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:52 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:53.768739 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-360ff5ba-e466-40d9-bc49-436fffacbcc0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:53.769352 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-360ff5ba-e466-40d9-bc49-436fffacbcc0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:53.775406 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-360ff5ba-e466-40d9-bc49-436fffacbcc0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:53.775890 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-360ff5ba-e466-40d9-bc49-436fffacbcc0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:53.776325 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-360ff5ba-e466-40d9-bc49-436fffacbcc0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:53.777019 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-360ff5ba-e466-40d9-bc49-436fffacbcc0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:53.777502 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-360ff5ba-e466-40d9-bc49-436fffacbcc0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:53.777962 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-360ff5ba-e466-40d9-bc49-436fffacbcc0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:53.878005 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9f610642-a942-4aff-9a41-32021b2190d2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:53.878615 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9f610642-a942-4aff-9a41-32021b2190d2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:53.884836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f610642-a942-4aff-9a41-32021b2190d2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:53.885325 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f610642-a942-4aff-9a41-32021b2190d2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:53.885810 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f610642-a942-4aff-9a41-32021b2190d2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:53.886575 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f610642-a942-4aff-9a41-32021b2190d2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:53.887025 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f610642-a942-4aff-9a41-32021b2190d2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:53.887444 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f610642-a942-4aff-9a41-32021b2190d2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:53.907108 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-360ff5ba-e466-40d9-bc49-436fffacbcc0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:53.914540 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-360ff5ba-e466-40d9-bc49-436fffacbcc0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.149696 Aug 04 22:22:53.915133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 196/387] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:53 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:54.025539 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9f610642-a942-4aff-9a41-32021b2190d2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:54.033071 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9f610642-a942-4aff-9a41-32021b2190d2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.159037 Aug 04 22:22:54.033685 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 192/388] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:53 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:54.936951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-be82043c-1c1d-4d90-af82-463a82b0b763 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:54.937615 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-be82043c-1c1d-4d90-af82-463a82b0b763 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:54.944122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-be82043c-1c1d-4d90-af82-463a82b0b763 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:54.944612 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-be82043c-1c1d-4d90-af82-463a82b0b763 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:54.945052 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-be82043c-1c1d-4d90-af82-463a82b0b763 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:54.945813 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-be82043c-1c1d-4d90-af82-463a82b0b763 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:54.946273 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-be82043c-1c1d-4d90-af82-463a82b0b763 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:54.946705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-be82043c-1c1d-4d90-af82-463a82b0b763 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:55.055668 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-2c049c85-eb2b-4426-a7cc-e8e335745c9f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:55.056282 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-2c049c85-eb2b-4426-a7cc-e8e335745c9f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:55.064297 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2c049c85-eb2b-4426-a7cc-e8e335745c9f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:55.065477 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2c049c85-eb2b-4426-a7cc-e8e335745c9f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:55.065921 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2c049c85-eb2b-4426-a7cc-e8e335745c9f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:55.067172 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2c049c85-eb2b-4426-a7cc-e8e335745c9f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:55.067172 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2c049c85-eb2b-4426-a7cc-e8e335745c9f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:55.067487 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2c049c85-eb2b-4426-a7cc-e8e335745c9f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:55.087321 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-be82043c-1c1d-4d90-af82-463a82b0b763 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:55.094760 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-be82043c-1c1d-4d90-af82-463a82b0b763 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.162463 Aug 04 22:22:55.095341 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 197/389] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:54 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:55.214027 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2c049c85-eb2b-4426-a7cc-e8e335745c9f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:55.221509 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-2c049c85-eb2b-4426-a7cc-e8e335745c9f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.170631 Aug 04 22:22:55.222070 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 193/390] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:55 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:56.115364 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-afa8ab86-cf95-4326-88b1-ac276bea2484 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:56.116069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-afa8ab86-cf95-4326-88b1-ac276bea2484 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:56.122469 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-afa8ab86-cf95-4326-88b1-ac276bea2484 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:56.123559 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-afa8ab86-cf95-4326-88b1-ac276bea2484 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:56.124149 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-afa8ab86-cf95-4326-88b1-ac276bea2484 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:56.124839 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-afa8ab86-cf95-4326-88b1-ac276bea2484 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:56.125284 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-afa8ab86-cf95-4326-88b1-ac276bea2484 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:56.125724 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-afa8ab86-cf95-4326-88b1-ac276bea2484 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:56.242506 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-31355df4-53cc-4917-804d-204976ebdc6e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:56.243124 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-31355df4-53cc-4917-804d-204976ebdc6e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:56.250141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-31355df4-53cc-4917-804d-204976ebdc6e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:56.250750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-31355df4-53cc-4917-804d-204976ebdc6e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:56.251185 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-31355df4-53cc-4917-804d-204976ebdc6e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:56.251880 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-31355df4-53cc-4917-804d-204976ebdc6e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:56.252359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-31355df4-53cc-4917-804d-204976ebdc6e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:56.252782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-31355df4-53cc-4917-804d-204976ebdc6e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:56.254384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-afa8ab86-cf95-4326-88b1-ac276bea2484 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:56.261980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-afa8ab86-cf95-4326-88b1-ac276bea2484 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.150701 Aug 04 22:22:56.262645 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 198/391] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:56 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:56.386779 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-31355df4-53cc-4917-804d-204976ebdc6e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:56.394597 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-31355df4-53cc-4917-804d-204976ebdc6e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.156515 Aug 04 22:22:56.395163 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 194/392] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:56 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:57.283689 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4ed4fc7e-0aee-48d5-b02a-bf5cd22f7cc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:57.284395 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4ed4fc7e-0aee-48d5-b02a-bf5cd22f7cc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:57.290569 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4ed4fc7e-0aee-48d5-b02a-bf5cd22f7cc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:57.291058 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4ed4fc7e-0aee-48d5-b02a-bf5cd22f7cc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:57.291497 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4ed4fc7e-0aee-48d5-b02a-bf5cd22f7cc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:57.292192 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4ed4fc7e-0aee-48d5-b02a-bf5cd22f7cc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:57.292653 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4ed4fc7e-0aee-48d5-b02a-bf5cd22f7cc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:57.293085 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4ed4fc7e-0aee-48d5-b02a-bf5cd22f7cc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:57.415987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c39cb86a-3586-4d8e-8d8d-cb9c6a40c6e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:57.416667 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c39cb86a-3586-4d8e-8d8d-cb9c6a40c6e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:57.420225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:22:57.424119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c39cb86a-3586-4d8e-8d8d-cb9c6a40c6e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:57.424619 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c39cb86a-3586-4d8e-8d8d-cb9c6a40c6e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:57.425056 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c39cb86a-3586-4d8e-8d8d-cb9c6a40c6e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:57.425490 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4ed4fc7e-0aee-48d5-b02a-bf5cd22f7cc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:57.425822 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c39cb86a-3586-4d8e-8d8d-cb9c6a40c6e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:57.426327 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c39cb86a-3586-4d8e-8d8d-cb9c6a40c6e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:57.426801 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c39cb86a-3586-4d8e-8d8d-cb9c6a40c6e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:57.436811 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4ed4fc7e-0aee-48d5-b02a-bf5cd22f7cc8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.157393 Aug 04 22:22:57.437977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 199/393] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:57 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:57.563497 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c39cb86a-3586-4d8e-8d8d-cb9c6a40c6e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:57.570842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c39cb86a-3586-4d8e-8d8d-cb9c6a40c6e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.158990 Aug 04 22:22:57.571403 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 195/394] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:57 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:58.460089 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-35c37331-e94d-4197-8436-9b43026b48da tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:58.460733 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-35c37331-e94d-4197-8436-9b43026b48da tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:58.467162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-35c37331-e94d-4197-8436-9b43026b48da tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:58.467580 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-35c37331-e94d-4197-8436-9b43026b48da tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:58.468015 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-35c37331-e94d-4197-8436-9b43026b48da tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:58.468808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-35c37331-e94d-4197-8436-9b43026b48da tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:58.469332 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-35c37331-e94d-4197-8436-9b43026b48da tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:58.469893 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-35c37331-e94d-4197-8436-9b43026b48da tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:58.592252 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8fbc3fc1-9f50-44a1-9486-c0dcd8636bdb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:58.592872 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8fbc3fc1-9f50-44a1-9486-c0dcd8636bdb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:58.599235 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fbc3fc1-9f50-44a1-9486-c0dcd8636bdb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:58.599720 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fbc3fc1-9f50-44a1-9486-c0dcd8636bdb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:58.600159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fbc3fc1-9f50-44a1-9486-c0dcd8636bdb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:58.600856 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fbc3fc1-9f50-44a1-9486-c0dcd8636bdb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:58.601341 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fbc3fc1-9f50-44a1-9486-c0dcd8636bdb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:58.601881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fbc3fc1-9f50-44a1-9486-c0dcd8636bdb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:58.607316 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-35c37331-e94d-4197-8436-9b43026b48da tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:58.615294 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-35c37331-e94d-4197-8436-9b43026b48da tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.159562 Aug 04 22:22:58.615863 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 200/395] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:58 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:58.739350 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8fbc3fc1-9f50-44a1-9486-c0dcd8636bdb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:58.747238 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8fbc3fc1-9f50-44a1-9486-c0dcd8636bdb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.158951 Aug 04 22:22:58.747812 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 196/396] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:58 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:22:59.636655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-54655c2a-ef66-4869-ae71-22d413c899ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:59.637303 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-54655c2a-ef66-4869-ae71-22d413c899ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:59.644001 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54655c2a-ef66-4869-ae71-22d413c899ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:59.644489 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54655c2a-ef66-4869-ae71-22d413c899ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:59.644928 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54655c2a-ef66-4869-ae71-22d413c899ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:59.645658 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54655c2a-ef66-4869-ae71-22d413c899ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:59.646119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54655c2a-ef66-4869-ae71-22d413c899ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:59.646549 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54655c2a-ef66-4869-ae71-22d413c899ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:59.768133 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d4c19a2f-2921-471f-9831-7c367ef40874 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:22:59.768753 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d4c19a2f-2921-471f-9831-7c367ef40874 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:22:59.775644 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4c19a2f-2921-471f-9831-7c367ef40874 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:59.776132 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4c19a2f-2921-471f-9831-7c367ef40874 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:59.776747 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4c19a2f-2921-471f-9831-7c367ef40874 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:59.777472 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4c19a2f-2921-471f-9831-7c367ef40874 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:22:59.778213 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4c19a2f-2921-471f-9831-7c367ef40874 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:22:59.778732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4c19a2f-2921-471f-9831-7c367ef40874 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:22:59.780930 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-54655c2a-ef66-4869-ae71-22d413c899ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:59.789127 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-54655c2a-ef66-4869-ae71-22d413c899ba tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.156283 Aug 04 22:22:59.789729 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 201/397] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:59 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:22:59.907970 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d4c19a2f-2921-471f-9831-7c367ef40874 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:22:59.915312 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d4c19a2f-2921-471f-9831-7c367ef40874 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.151046 Aug 04 22:22:59.915878 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 197/398] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:22:59 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:00.811140 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6f6a2e9b-230b-4746-b5ca-e29ba14fdff3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:00.811748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6f6a2e9b-230b-4746-b5ca-e29ba14fdff3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:00.817667 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f6a2e9b-230b-4746-b5ca-e29ba14fdff3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:00.818153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f6a2e9b-230b-4746-b5ca-e29ba14fdff3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:00.818620 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f6a2e9b-230b-4746-b5ca-e29ba14fdff3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:00.819317 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f6a2e9b-230b-4746-b5ca-e29ba14fdff3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:00.819766 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f6a2e9b-230b-4746-b5ca-e29ba14fdff3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:00.820183 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f6a2e9b-230b-4746-b5ca-e29ba14fdff3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:00.936135 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d950ed52-b1c1-4623-bea1-34eff92110fe tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:00.936753 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d950ed52-b1c1-4623-bea1-34eff92110fe tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:00.943738 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d950ed52-b1c1-4623-bea1-34eff92110fe tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:00.944237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d950ed52-b1c1-4623-bea1-34eff92110fe tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:00.944685 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d950ed52-b1c1-4623-bea1-34eff92110fe tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:00.945386 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d950ed52-b1c1-4623-bea1-34eff92110fe tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:00.945931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d950ed52-b1c1-4623-bea1-34eff92110fe tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:00.946381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d950ed52-b1c1-4623-bea1-34eff92110fe tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:00.954304 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6f6a2e9b-230b-4746-b5ca-e29ba14fdff3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:00.961648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6f6a2e9b-230b-4746-b5ca-e29ba14fdff3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.155114 Aug 04 22:23:00.962220 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 202/399] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:00 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:01.079821 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d950ed52-b1c1-4623-bea1-34eff92110fe tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:01.087184 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d950ed52-b1c1-4623-bea1-34eff92110fe tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.154968 Aug 04 22:23:01.087755 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 198/400] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:00 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:01.982850 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a6a9b3b1-f7d1-41f8-a69a-ce2520db2c63 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:01.983460 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a6a9b3b1-f7d1-41f8-a69a-ce2520db2c63 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:01.989383 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6a9b3b1-f7d1-41f8-a69a-ce2520db2c63 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:01.989906 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6a9b3b1-f7d1-41f8-a69a-ce2520db2c63 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:01.990347 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6a9b3b1-f7d1-41f8-a69a-ce2520db2c63 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:01.991044 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6a9b3b1-f7d1-41f8-a69a-ce2520db2c63 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:01.991501 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6a9b3b1-f7d1-41f8-a69a-ce2520db2c63 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:01.991929 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6a9b3b1-f7d1-41f8-a69a-ce2520db2c63 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:02.109822 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3e77ddc8-2515-4199-8855-72e9dae3b219 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:02.111393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3e77ddc8-2515-4199-8855-72e9dae3b219 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:02.120266 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e77ddc8-2515-4199-8855-72e9dae3b219 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:02.120751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e77ddc8-2515-4199-8855-72e9dae3b219 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:02.121229 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e77ddc8-2515-4199-8855-72e9dae3b219 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:02.125301 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a6a9b3b1-f7d1-41f8-a69a-ce2520db2c63 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:02.128780 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e77ddc8-2515-4199-8855-72e9dae3b219 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:02.129278 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e77ddc8-2515-4199-8855-72e9dae3b219 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:02.129756 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e77ddc8-2515-4199-8855-72e9dae3b219 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:02.132630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a6a9b3b1-f7d1-41f8-a69a-ce2520db2c63 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.154154 Aug 04 22:23:02.133193 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 203/401] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:01 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:02.259391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3e77ddc8-2515-4199-8855-72e9dae3b219 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:02.266944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3e77ddc8-2515-4199-8855-72e9dae3b219 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.162521 Aug 04 22:23:02.267514 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 199/402] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:02 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:03.155013 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-aeb9a511-d7d7-4df3-b30d-dcc4e775cfef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:03.155614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-aeb9a511-d7d7-4df3-b30d-dcc4e775cfef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:03.161667 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aeb9a511-d7d7-4df3-b30d-dcc4e775cfef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:03.162349 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aeb9a511-d7d7-4df3-b30d-dcc4e775cfef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:03.162778 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aeb9a511-d7d7-4df3-b30d-dcc4e775cfef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:03.163473 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aeb9a511-d7d7-4df3-b30d-dcc4e775cfef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:03.163934 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aeb9a511-d7d7-4df3-b30d-dcc4e775cfef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:03.164348 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aeb9a511-d7d7-4df3-b30d-dcc4e775cfef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:03.179407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=100 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:03.287908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9cf585c3-bb0c-45c9-8f12-74e68a2f6194 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:03.288516 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9cf585c3-bb0c-45c9-8f12-74e68a2f6194 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:03.294892 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9cf585c3-bb0c-45c9-8f12-74e68a2f6194 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:03.295376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9cf585c3-bb0c-45c9-8f12-74e68a2f6194 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:03.295806 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9cf585c3-bb0c-45c9-8f12-74e68a2f6194 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:03.296496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9cf585c3-bb0c-45c9-8f12-74e68a2f6194 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:03.296972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9cf585c3-bb0c-45c9-8f12-74e68a2f6194 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:03.297394 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9cf585c3-bb0c-45c9-8f12-74e68a2f6194 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:03.298857 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-aeb9a511-d7d7-4df3-b30d-dcc4e775cfef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:03.306342 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-aeb9a511-d7d7-4df3-b30d-dcc4e775cfef tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.155913 Aug 04 22:23:03.306909 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 204/403] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:03 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:03.430441 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9cf585c3-bb0c-45c9-8f12-74e68a2f6194 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:03.438506 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9cf585c3-bb0c-45c9-8f12-74e68a2f6194 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.154517 Aug 04 22:23:03.439087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 200/404] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:03 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:04.331019 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d19f10d3-8b20-491c-b27f-3528f98bbd8b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:04.332320 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d19f10d3-8b20-491c-b27f-3528f98bbd8b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:04.345279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d19f10d3-8b20-491c-b27f-3528f98bbd8b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:04.345947 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d19f10d3-8b20-491c-b27f-3528f98bbd8b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:04.346536 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d19f10d3-8b20-491c-b27f-3528f98bbd8b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:04.347515 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d19f10d3-8b20-491c-b27f-3528f98bbd8b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:04.360366 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d19f10d3-8b20-491c-b27f-3528f98bbd8b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:04.361372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d19f10d3-8b20-491c-b27f-3528f98bbd8b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:04.460335 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-591b894d-88de-4302-8ce5-f6b3ab38370c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:04.461020 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-591b894d-88de-4302-8ce5-f6b3ab38370c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:04.469081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-591b894d-88de-4302-8ce5-f6b3ab38370c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:04.470463 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-591b894d-88de-4302-8ce5-f6b3ab38370c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:04.470989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-591b894d-88de-4302-8ce5-f6b3ab38370c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:04.471753 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-591b894d-88de-4302-8ce5-f6b3ab38370c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:04.472419 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-591b894d-88de-4302-8ce5-f6b3ab38370c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:04.472933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-591b894d-88de-4302-8ce5-f6b3ab38370c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:04.583742 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d19f10d3-8b20-491c-b27f-3528f98bbd8b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:04.592285 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d19f10d3-8b20-491c-b27f-3528f98bbd8b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.266592 Aug 04 22:23:04.592862 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 205/405] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:04 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:04.597193 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-4932d112-2459-4b42-8dd6-4bc5837aad7a req-f5794f43-864d-49c5-afa8-3eb36156b480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe4f98c-ef1c-4ff7-886c-aa5f6fba4060", "name": "network-vif-plugged", "status": "completed", "tag": "9b827747-2bc5-47da-a103-19ea8f8e7429"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:23:04.606154 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-4932d112-2459-4b42-8dd6-4bc5837aad7a req-f5794f43-864d-49c5-afa8-3eb36156b480 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:04.606861 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-4932d112-2459-4b42-8dd6-4bc5837aad7a req-f5794f43-864d-49c5-afa8-3eb36156b480 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:04.607303 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-4932d112-2459-4b42-8dd6-4bc5837aad7a req-f5794f43-864d-49c5-afa8-3eb36156b480 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:04.618202 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-4932d112-2459-4b42-8dd6-4bc5837aad7a req-f5794f43-864d-49c5-afa8-3eb36156b480 service nova] Creating event network-vif-plugged:9b827747-2bc5-47da-a103-19ea8f8e7429 for instance abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 on hv-cinder-85221 Aug 04 22:23:04.624212 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-4932d112-2459-4b42-8dd6-4bc5837aad7a req-f5794f43-864d-49c5-afa8-3eb36156b480 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030109 Aug 04 22:23:04.624807 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 206/406] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:23:04.637003 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-591b894d-88de-4302-8ce5-f6b3ab38370c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:04.645139 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-591b894d-88de-4302-8ce5-f6b3ab38370c tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.189788 Aug 04 22:23:04.645744 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 201/407] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:04 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:05.614039 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d4059c4d-be69-41b6-9db9-360c84f44f0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:05.614733 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d4059c4d-be69-41b6-9db9-360c84f44f0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:05.621431 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4059c4d-be69-41b6-9db9-360c84f44f0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:05.621946 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4059c4d-be69-41b6-9db9-360c84f44f0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:05.622502 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4059c4d-be69-41b6-9db9-360c84f44f0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:05.623190 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4059c4d-be69-41b6-9db9-360c84f44f0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:05.623643 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4059c4d-be69-41b6-9db9-360c84f44f0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:05.624062 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4059c4d-be69-41b6-9db9-360c84f44f0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:05.666201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c679a74a-4a3a-4a9d-8514-b86a311b440e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:05.666811 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c679a74a-4a3a-4a9d-8514-b86a311b440e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:05.673787 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c679a74a-4a3a-4a9d-8514-b86a311b440e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:05.674263 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c679a74a-4a3a-4a9d-8514-b86a311b440e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:05.674689 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c679a74a-4a3a-4a9d-8514-b86a311b440e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:05.675370 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c679a74a-4a3a-4a9d-8514-b86a311b440e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:05.675816 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c679a74a-4a3a-4a9d-8514-b86a311b440e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:05.676233 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c679a74a-4a3a-4a9d-8514-b86a311b440e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:05.693777 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:05.753824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d4059c4d-be69-41b6-9db9-360c84f44f0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:05.761513 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d4059c4d-be69-41b6-9db9-360c84f44f0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.151511 Aug 04 22:23:05.762097 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 207/408] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:05 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:05.807852 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c679a74a-4a3a-4a9d-8514-b86a311b440e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:05.815801 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c679a74a-4a3a-4a9d-8514-b86a311b440e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.153427 Aug 04 22:23:05.816356 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 202/409] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:05 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:06.783990 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6e103b8e-5366-43f7-8cca-fcc1f47ed4b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:06.784584 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6e103b8e-5366-43f7-8cca-fcc1f47ed4b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:06.790583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6e103b8e-5366-43f7-8cca-fcc1f47ed4b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:06.791052 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6e103b8e-5366-43f7-8cca-fcc1f47ed4b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:06.791489 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6e103b8e-5366-43f7-8cca-fcc1f47ed4b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:06.792179 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6e103b8e-5366-43f7-8cca-fcc1f47ed4b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:06.792637 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6e103b8e-5366-43f7-8cca-fcc1f47ed4b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:06.793063 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6e103b8e-5366-43f7-8cca-fcc1f47ed4b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:06.835927 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-75109f09-0893-4abe-b0ab-5e4de5bdd958 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:06.836536 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-75109f09-0893-4abe-b0ab-5e4de5bdd958 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:06.844224 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-75109f09-0893-4abe-b0ab-5e4de5bdd958 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:06.844801 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-75109f09-0893-4abe-b0ab-5e4de5bdd958 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:06.845305 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-75109f09-0893-4abe-b0ab-5e4de5bdd958 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:06.846097 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-75109f09-0893-4abe-b0ab-5e4de5bdd958 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:06.846616 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-75109f09-0893-4abe-b0ab-5e4de5bdd958 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:06.847144 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-75109f09-0893-4abe-b0ab-5e4de5bdd958 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:06.929475 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6e103b8e-5366-43f7-8cca-fcc1f47ed4b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:06.937585 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6e103b8e-5366-43f7-8cca-fcc1f47ed4b1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.157353 Aug 04 22:23:06.938162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 208/410] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:06 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:06.983795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-75109f09-0893-4abe-b0ab-5e4de5bdd958 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:06.991260 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-75109f09-0893-4abe-b0ab-5e4de5bdd958 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.159086 Aug 04 22:23:06.991829 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 203/411] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:06 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:07.958732 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-323c7753-926b-434e-9837-e46702ad9a0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:07.959341 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-323c7753-926b-434e-9837-e46702ad9a0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:07.966037 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-323c7753-926b-434e-9837-e46702ad9a0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:07.967062 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-323c7753-926b-434e-9837-e46702ad9a0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:07.967505 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-323c7753-926b-434e-9837-e46702ad9a0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:07.968202 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-323c7753-926b-434e-9837-e46702ad9a0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:07.968663 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-323c7753-926b-434e-9837-e46702ad9a0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:07.969139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-323c7753-926b-434e-9837-e46702ad9a0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:08.013603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-dc832eea-ada3-4160-b28c-94ae8e83bb49 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:08.014214 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-dc832eea-ada3-4160-b28c-94ae8e83bb49 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:08.020556 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc832eea-ada3-4160-b28c-94ae8e83bb49 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:08.021032 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc832eea-ada3-4160-b28c-94ae8e83bb49 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:08.021482 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc832eea-ada3-4160-b28c-94ae8e83bb49 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:08.022174 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc832eea-ada3-4160-b28c-94ae8e83bb49 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:08.022620 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc832eea-ada3-4160-b28c-94ae8e83bb49 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:08.023035 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc832eea-ada3-4160-b28c-94ae8e83bb49 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:08.101621 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-323c7753-926b-434e-9837-e46702ad9a0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:08.109686 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-323c7753-926b-434e-9837-e46702ad9a0c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.154582 Aug 04 22:23:08.110365 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 209/412] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:07 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:08.157795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-dc832eea-ada3-4160-b28c-94ae8e83bb49 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:08.165203 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-dc832eea-ada3-4160-b28c-94ae8e83bb49 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.156173 Aug 04 22:23:08.165798 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 204/413] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:08 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:09.131585 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-911db6ad-fb62-49b5-aca4-ed1cc0003d88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:09.132193 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-911db6ad-fb62-49b5-aca4-ed1cc0003d88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:09.138207 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-911db6ad-fb62-49b5-aca4-ed1cc0003d88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:09.138689 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-911db6ad-fb62-49b5-aca4-ed1cc0003d88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:09.139117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-911db6ad-fb62-49b5-aca4-ed1cc0003d88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:09.139800 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-911db6ad-fb62-49b5-aca4-ed1cc0003d88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:09.140248 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-911db6ad-fb62-49b5-aca4-ed1cc0003d88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:09.140665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-911db6ad-fb62-49b5-aca4-ed1cc0003d88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:09.186406 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d63dd8fe-02ed-4817-9170-d0a88fd5881d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:09.187046 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d63dd8fe-02ed-4817-9170-d0a88fd5881d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:09.193659 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d63dd8fe-02ed-4817-9170-d0a88fd5881d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:09.194170 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d63dd8fe-02ed-4817-9170-d0a88fd5881d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:09.194606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d63dd8fe-02ed-4817-9170-d0a88fd5881d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:09.195327 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d63dd8fe-02ed-4817-9170-d0a88fd5881d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:09.195780 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d63dd8fe-02ed-4817-9170-d0a88fd5881d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:09.196205 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d63dd8fe-02ed-4817-9170-d0a88fd5881d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:09.273921 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-911db6ad-fb62-49b5-aca4-ed1cc0003d88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:09.282235 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-911db6ad-fb62-49b5-aca4-ed1cc0003d88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.154520 Aug 04 22:23:09.283054 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 210/414] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:09 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:09.333596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d63dd8fe-02ed-4817-9170-d0a88fd5881d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:09.340967 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d63dd8fe-02ed-4817-9170-d0a88fd5881d tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.158596 Aug 04 22:23:09.341636 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 205/415] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:09 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:10.303173 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-395093f4-ee0e-42a4-ab13-9a09d709eb98 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:10.303871 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-395093f4-ee0e-42a4-ab13-9a09d709eb98 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:10.310513 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-395093f4-ee0e-42a4-ab13-9a09d709eb98 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:10.311008 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-395093f4-ee0e-42a4-ab13-9a09d709eb98 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:10.311450 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-395093f4-ee0e-42a4-ab13-9a09d709eb98 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:10.312150 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-395093f4-ee0e-42a4-ab13-9a09d709eb98 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:10.312612 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-395093f4-ee0e-42a4-ab13-9a09d709eb98 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:10.313042 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-395093f4-ee0e-42a4-ab13-9a09d709eb98 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:10.361836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4d08287a-8c43-414e-9318-e4ee9b9c8044 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:10.362540 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4d08287a-8c43-414e-9318-e4ee9b9c8044 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:10.370016 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4d08287a-8c43-414e-9318-e4ee9b9c8044 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:10.370565 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4d08287a-8c43-414e-9318-e4ee9b9c8044 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:10.371061 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4d08287a-8c43-414e-9318-e4ee9b9c8044 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:10.371855 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4d08287a-8c43-414e-9318-e4ee9b9c8044 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:10.372349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4d08287a-8c43-414e-9318-e4ee9b9c8044 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:10.372842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4d08287a-8c43-414e-9318-e4ee9b9c8044 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:10.447013 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-395093f4-ee0e-42a4-ab13-9a09d709eb98 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:10.455606 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-395093f4-ee0e-42a4-ab13-9a09d709eb98 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.156268 Aug 04 22:23:10.456181 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 211/416] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:10 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:10.508475 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4d08287a-8c43-414e-9318-e4ee9b9c8044 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:10.516514 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4d08287a-8c43-414e-9318-e4ee9b9c8044 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.159145 Aug 04 22:23:10.517085 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 206/417] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:10 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:11.478640 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-26908c32-f437-4807-830e-eac5331ed4c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:11.479247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-26908c32-f437-4807-830e-eac5331ed4c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:11.485714 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26908c32-f437-4807-830e-eac5331ed4c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:11.486195 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26908c32-f437-4807-830e-eac5331ed4c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:11.486623 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26908c32-f437-4807-830e-eac5331ed4c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:11.487302 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26908c32-f437-4807-830e-eac5331ed4c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:11.487750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26908c32-f437-4807-830e-eac5331ed4c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:11.488168 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26908c32-f437-4807-830e-eac5331ed4c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:11.537616 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a7dff052-8aa3-457f-b7ee-73fac9e5996e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:11.538234 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a7dff052-8aa3-457f-b7ee-73fac9e5996e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:11.545335 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7dff052-8aa3-457f-b7ee-73fac9e5996e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:11.545843 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7dff052-8aa3-457f-b7ee-73fac9e5996e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:11.546270 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7dff052-8aa3-457f-b7ee-73fac9e5996e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:11.546963 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7dff052-8aa3-457f-b7ee-73fac9e5996e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:11.547410 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7dff052-8aa3-457f-b7ee-73fac9e5996e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:11.547830 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7dff052-8aa3-457f-b7ee-73fac9e5996e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:11.618878 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-26908c32-f437-4807-830e-eac5331ed4c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:11.626359 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-26908c32-f437-4807-830e-eac5331ed4c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.151561 Aug 04 22:23:11.627157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 212/418] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:11 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:11.678498 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a7dff052-8aa3-457f-b7ee-73fac9e5996e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:11.685871 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a7dff052-8aa3-457f-b7ee-73fac9e5996e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.152050 Aug 04 22:23:11.686434 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 207/419] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:11 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:12.647105 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a990e2e5-9aa8-4ab9-99de-af253ecba725 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:12.647690 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a990e2e5-9aa8-4ab9-99de-af253ecba725 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:12.653831 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a990e2e5-9aa8-4ab9-99de-af253ecba725 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:12.654312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a990e2e5-9aa8-4ab9-99de-af253ecba725 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:12.654743 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a990e2e5-9aa8-4ab9-99de-af253ecba725 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:12.655429 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a990e2e5-9aa8-4ab9-99de-af253ecba725 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:12.655879 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a990e2e5-9aa8-4ab9-99de-af253ecba725 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:12.656298 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a990e2e5-9aa8-4ab9-99de-af253ecba725 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:12.706117 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-cad0eedf-cb57-4fe6-84b8-cda03093c2e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:12.706731 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-cad0eedf-cb57-4fe6-84b8-cda03093c2e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:12.713101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cad0eedf-cb57-4fe6-84b8-cda03093c2e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:12.713618 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cad0eedf-cb57-4fe6-84b8-cda03093c2e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:12.714049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cad0eedf-cb57-4fe6-84b8-cda03093c2e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:12.715535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cad0eedf-cb57-4fe6-84b8-cda03093c2e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:12.715535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cad0eedf-cb57-4fe6-84b8-cda03093c2e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:12.715771 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cad0eedf-cb57-4fe6-84b8-cda03093c2e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:12.792793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a990e2e5-9aa8-4ab9-99de-af253ecba725 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:12.800853 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a990e2e5-9aa8-4ab9-99de-af253ecba725 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.157555 Aug 04 22:23:12.801817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 213/420] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:12 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:12.857289 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-cad0eedf-cb57-4fe6-84b8-cda03093c2e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:12.867980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-cad0eedf-cb57-4fe6-84b8-cda03093c2e2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.165463 Aug 04 22:23:12.868885 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 208/421] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:12 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:13.821120 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e4e84601-2dd9-40c5-8443-aceb784a66ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:13.821779 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e4e84601-2dd9-40c5-8443-aceb784a66ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:13.828296 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e4e84601-2dd9-40c5-8443-aceb784a66ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:13.828780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e4e84601-2dd9-40c5-8443-aceb784a66ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:13.829217 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e4e84601-2dd9-40c5-8443-aceb784a66ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:13.829972 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e4e84601-2dd9-40c5-8443-aceb784a66ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:13.830478 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e4e84601-2dd9-40c5-8443-aceb784a66ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:13.830906 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e4e84601-2dd9-40c5-8443-aceb784a66ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:13.890217 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a83e36b6-8327-44bd-9a55-326c03592fb0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:13.890821 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a83e36b6-8327-44bd-9a55-326c03592fb0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:13.897366 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a83e36b6-8327-44bd-9a55-326c03592fb0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:13.897891 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a83e36b6-8327-44bd-9a55-326c03592fb0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:13.898326 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a83e36b6-8327-44bd-9a55-326c03592fb0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:13.899022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a83e36b6-8327-44bd-9a55-326c03592fb0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:13.899471 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a83e36b6-8327-44bd-9a55-326c03592fb0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:13.899897 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a83e36b6-8327-44bd-9a55-326c03592fb0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:13.962467 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e4e84601-2dd9-40c5-8443-aceb784a66ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:13.970811 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e4e84601-2dd9-40c5-8443-aceb784a66ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.153420 Aug 04 22:23:13.971418 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 214/422] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:13 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:14.033567 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a83e36b6-8327-44bd-9a55-326c03592fb0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:14.041091 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a83e36b6-8327-44bd-9a55-326c03592fb0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.155982 Aug 04 22:23:14.041710 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 209/423] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:13 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:14.992029 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-638ffce6-eb07-4bb6-809b-fd0ad6eb736b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:14.992788 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-638ffce6-eb07-4bb6-809b-fd0ad6eb736b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:14.999039 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-638ffce6-eb07-4bb6-809b-fd0ad6eb736b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:14.999520 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-638ffce6-eb07-4bb6-809b-fd0ad6eb736b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:14.999950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-638ffce6-eb07-4bb6-809b-fd0ad6eb736b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:15.000633 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-638ffce6-eb07-4bb6-809b-fd0ad6eb736b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:15.001137 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-638ffce6-eb07-4bb6-809b-fd0ad6eb736b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:15.001603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-638ffce6-eb07-4bb6-809b-fd0ad6eb736b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:15.062010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-26c4587d-00c0-42a2-a709-2ea7359b5afc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:15.063569 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-26c4587d-00c0-42a2-a709-2ea7359b5afc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:15.071597 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-26c4587d-00c0-42a2-a709-2ea7359b5afc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:15.072684 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-26c4587d-00c0-42a2-a709-2ea7359b5afc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:15.073668 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-26c4587d-00c0-42a2-a709-2ea7359b5afc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:15.075255 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-26c4587d-00c0-42a2-a709-2ea7359b5afc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:15.075894 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-26c4587d-00c0-42a2-a709-2ea7359b5afc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:15.076496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-26c4587d-00c0-42a2-a709-2ea7359b5afc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:15.157716 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-638ffce6-eb07-4bb6-809b-fd0ad6eb736b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:15.165091 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-638ffce6-eb07-4bb6-809b-fd0ad6eb736b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1506 microversion: 2.1 time: 0.176887 Aug 04 22:23:15.165681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 215/424] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:14 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:15.186080 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-93ef3134-aa64-43a4-9e4f-18fe1162a55c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "361c26f3-0788-48fc-b66a-10deab35a190"}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:23:15.188403 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-93ef3134-aa64-43a4-9e4f-18fe1162a55c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:15.194284 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93ef3134-aa64-43a4-9e4f-18fe1162a55c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:15.194771 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93ef3134-aa64-43a4-9e4f-18fe1162a55c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:15.195207 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93ef3134-aa64-43a4-9e4f-18fe1162a55c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:15.195903 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93ef3134-aa64-43a4-9e4f-18fe1162a55c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:15.196356 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93ef3134-aa64-43a4-9e4f-18fe1162a55c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:15.196779 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93ef3134-aa64-43a4-9e4f-18fe1162a55c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:15.220172 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-93ef3134-aa64-43a4-9e4f-18fe1162a55c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] HTTP exception thrown: Cannot 'attach_volume' instance 6318eb70-fdcf-4545-b737-61e032221d53 while it is in vm_state rescued Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-93ef3134-aa64-43a4-9e4f-18fe1162a55c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Request method failure captured: Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: POST /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53/os-volume_attachments HTTP/1.1 Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 74 Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYrBl6iVSsbeUBGuNUsCrcR_k9iol3MjGtflczYOd1VVWaNljGEka8fyS_szpgwEG027Pb-gXKzAyoPcqSTNny01b2nKUjZVmNL3L-UuiR2ay4JqGJewr8wM744kJa6rrGR2Z06pY_jnaOVvdsETxhEF674NYDOdgIbxMjU0W1UhHg Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 5116986e2edc4b5c92da0b77a497910a Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:23:15.221881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:23:15.223188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/5116986e2edc4b5c92da0b77a497910a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_5116986e2edc4b5c92da0b77a497910a", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/5116986e2edc4b5c92da0b77a497910a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/5116986e2edc4b5c92da0b77a497910a"}]}] Aug 04 22:23:15.223188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:23:15.223188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 5116986e2edc4b5c92da0b77a497910a Aug 04 22:23:15.223188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:23:15.223188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-ServerRescueNegativeTestJSON-1760242217-project Aug 04 22:23:15.223188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:23:15.223188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:23:15.223188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: f3dab07011da408c97ed90d58f2c155b Aug 04 22:23:15.223188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1760242217-project Aug 04 22:23:15.223188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Aug 04 22:23:15.223188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {"volumeAttachment": {"volumeId": "361c26f3-0788-48fc-b66a-10deab35a190"}} Aug 04 22:23:15.223188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Cannot 'attach_volume' instance 6318eb70-fdcf-4545-b737-61e032221d53 while it is in vm_state rescued Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'server_id': '6318eb70-fdcf-4545-b737-61e032221d53', 'body': {'volumeAttachment': {'volumeId': '361c26f3-0788-48fc-b66a-10deab35a190'}}} Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6318eb70-fdcf-4545-b737-61e032221d53 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:23:15.224117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6318eb70-fdcf-4545-b737-61e032221d53 while it is in vm_state rescued Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:23:15.225456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:23:15.226668 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:23:15.226668 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:23:15.226668 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6318eb70-fdcf-4545-b737-61e032221d53 while it is in vm_state rescued Aug 04 22:23:15.226668 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:23:15.226668 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-93ef3134-aa64-43a4-9e4f-18fe1162a55c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Returning 409 to user: Cannot 'attach_volume' instance 6318eb70-fdcf-4545-b737-61e032221d53 while it is in vm_state rescued {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:23:15.226668 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-93ef3134-aa64-43a4-9e4f-18fe1162a55c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "POST /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041686 Aug 04 22:23:15.226668 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 216/425] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:23:15 2022] POST /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 22:23:15.227990 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-26c4587d-00c0-42a2-a709-2ea7359b5afc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:15.232792 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-080f5163-16b9-463b-a98c-198cacbb6b43 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:23:15.233344 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-080f5163-16b9-463b-a98c-198cacbb6b43 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:15.235589 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-26c4587d-00c0-42a2-a709-2ea7359b5afc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.178045 Aug 04 22:23:15.236156 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 210/426] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:15 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:15.239332 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-080f5163-16b9-463b-a98c-198cacbb6b43 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:15.239810 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-080f5163-16b9-463b-a98c-198cacbb6b43 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:15.240241 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-080f5163-16b9-463b-a98c-198cacbb6b43 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:15.240960 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-080f5163-16b9-463b-a98c-198cacbb6b43 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:15.241418 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-080f5163-16b9-463b-a98c-198cacbb6b43 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:15.241852 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-080f5163-16b9-463b-a98c-198cacbb6b43 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:15.308228 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-080f5163-16b9-463b-a98c-198cacbb6b43 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "POST /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53/action" status: 202 len: 0 microversion: 2.1 time: 0.079570 Aug 04 22:23:15.309916 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 217/427] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:23:15 2022] POST /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 22:23:15.317347 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0e7da8ce-f800-43d1-bac4-f960ededc12e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:15.317928 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0e7da8ce-f800-43d1-bac4-f960ededc12e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:15.323751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0e7da8ce-f800-43d1-bac4-f960ededc12e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:15.324241 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0e7da8ce-f800-43d1-bac4-f960ededc12e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:15.325274 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0e7da8ce-f800-43d1-bac4-f960ededc12e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:15.325993 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0e7da8ce-f800-43d1-bac4-f960ededc12e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:15.326447 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0e7da8ce-f800-43d1-bac4-f960ededc12e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:15.326874 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0e7da8ce-f800-43d1-bac4-f960ededc12e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:15.454771 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0e7da8ce-f800-43d1-bac4-f960ededc12e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:15.462209 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0e7da8ce-f800-43d1-bac4-f960ededc12e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.148731 Aug 04 22:23:15.462790 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 211/428] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:15 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:16.256495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b6408fb0-5774-421b-a538-3d8005351c3a tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:16.257181 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b6408fb0-5774-421b-a538-3d8005351c3a tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:16.259136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=58 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:16.265535 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6408fb0-5774-421b-a538-3d8005351c3a tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:16.266029 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6408fb0-5774-421b-a538-3d8005351c3a tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:16.266470 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6408fb0-5774-421b-a538-3d8005351c3a tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:16.267170 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6408fb0-5774-421b-a538-3d8005351c3a tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:16.267627 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6408fb0-5774-421b-a538-3d8005351c3a tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:16.268086 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6408fb0-5774-421b-a538-3d8005351c3a tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:16.400876 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b6408fb0-5774-421b-a538-3d8005351c3a tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:16.408653 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b6408fb0-5774-421b-a538-3d8005351c3a tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.156325 Aug 04 22:23:16.409229 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 218/429] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:16 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:16.484586 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-729dfc8e-0db5-4b4e-9a01-987f944e4147 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:16.485200 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-729dfc8e-0db5-4b4e-9a01-987f944e4147 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:16.491729 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-729dfc8e-0db5-4b4e-9a01-987f944e4147 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:16.492296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-729dfc8e-0db5-4b4e-9a01-987f944e4147 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:16.492735 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-729dfc8e-0db5-4b4e-9a01-987f944e4147 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:16.493731 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-729dfc8e-0db5-4b4e-9a01-987f944e4147 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:16.494196 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-729dfc8e-0db5-4b4e-9a01-987f944e4147 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:16.494629 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-729dfc8e-0db5-4b4e-9a01-987f944e4147 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:16.628338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-729dfc8e-0db5-4b4e-9a01-987f944e4147 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:16.635736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-729dfc8e-0db5-4b4e-9a01-987f944e4147 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.155503 Aug 04 22:23:16.636296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 212/430] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:16 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:17.435370 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-092353ba-96b3-4808-974c-b0b56499e354 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:17.435898 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-092353ba-96b3-4808-974c-b0b56499e354 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:17.441526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-092353ba-96b3-4808-974c-b0b56499e354 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:17.442016 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-092353ba-96b3-4808-974c-b0b56499e354 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:17.442453 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-092353ba-96b3-4808-974c-b0b56499e354 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:17.443147 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-092353ba-96b3-4808-974c-b0b56499e354 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:17.443605 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-092353ba-96b3-4808-974c-b0b56499e354 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:17.444033 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-092353ba-96b3-4808-974c-b0b56499e354 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:17.578343 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-092353ba-96b3-4808-974c-b0b56499e354 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:17.585641 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-092353ba-96b3-4808-974c-b0b56499e354 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.154926 Aug 04 22:23:17.586199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 219/431] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:17 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:17.656541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7dd47ad4-573f-4ede-a2eb-8c1c99eb2c9f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:17.657152 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7dd47ad4-573f-4ede-a2eb-8c1c99eb2c9f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:17.663623 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7dd47ad4-573f-4ede-a2eb-8c1c99eb2c9f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:17.664111 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7dd47ad4-573f-4ede-a2eb-8c1c99eb2c9f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:17.664542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7dd47ad4-573f-4ede-a2eb-8c1c99eb2c9f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:17.665239 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7dd47ad4-573f-4ede-a2eb-8c1c99eb2c9f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:17.665727 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7dd47ad4-573f-4ede-a2eb-8c1c99eb2c9f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:17.666138 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7dd47ad4-573f-4ede-a2eb-8c1c99eb2c9f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:17.793266 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7dd47ad4-573f-4ede-a2eb-8c1c99eb2c9f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:17.801288 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7dd47ad4-573f-4ede-a2eb-8c1c99eb2c9f tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.148696 Aug 04 22:23:17.801965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 213/432] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:17 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:18.606487 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-24568767-1090-4f25-bcd8-55761b2f95cf tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:18.607182 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-24568767-1090-4f25-bcd8-55761b2f95cf tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:18.612986 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-24568767-1090-4f25-bcd8-55761b2f95cf tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:18.613501 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-24568767-1090-4f25-bcd8-55761b2f95cf tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:18.613936 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-24568767-1090-4f25-bcd8-55761b2f95cf tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:18.614617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-24568767-1090-4f25-bcd8-55761b2f95cf tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:18.615062 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-24568767-1090-4f25-bcd8-55761b2f95cf tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:18.615482 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-24568767-1090-4f25-bcd8-55761b2f95cf tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:18.743709 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-24568767-1090-4f25-bcd8-55761b2f95cf tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:18.751359 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-24568767-1090-4f25-bcd8-55761b2f95cf tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.148759 Aug 04 22:23:18.751920 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 220/433] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:18 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:18.822488 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-2561d86f-50de-4eda-9f57-b846b7c4c12b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:18.823128 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-2561d86f-50de-4eda-9f57-b846b7c4c12b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:18.830217 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2561d86f-50de-4eda-9f57-b846b7c4c12b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:18.830707 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2561d86f-50de-4eda-9f57-b846b7c4c12b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:18.831145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2561d86f-50de-4eda-9f57-b846b7c4c12b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:18.831841 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2561d86f-50de-4eda-9f57-b846b7c4c12b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:18.832301 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2561d86f-50de-4eda-9f57-b846b7c4c12b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:18.832735 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2561d86f-50de-4eda-9f57-b846b7c4c12b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:18.962131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2561d86f-50de-4eda-9f57-b846b7c4c12b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:18.969727 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-2561d86f-50de-4eda-9f57-b846b7c4c12b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.151006 Aug 04 22:23:18.970290 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 214/434] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:18 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:19.772414 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-96fcc3dd-5b07-4db3-9b4b-7fe0675b2ec9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:19.773069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-96fcc3dd-5b07-4db3-9b4b-7fe0675b2ec9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:19.780259 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-96fcc3dd-5b07-4db3-9b4b-7fe0675b2ec9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:19.780745 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-96fcc3dd-5b07-4db3-9b4b-7fe0675b2ec9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:19.781181 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-96fcc3dd-5b07-4db3-9b4b-7fe0675b2ec9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:19.781908 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-96fcc3dd-5b07-4db3-9b4b-7fe0675b2ec9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:19.782369 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-96fcc3dd-5b07-4db3-9b4b-7fe0675b2ec9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:19.782794 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-96fcc3dd-5b07-4db3-9b4b-7fe0675b2ec9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:19.785507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:19.916533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-96fcc3dd-5b07-4db3-9b4b-7fe0675b2ec9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:19.924640 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-96fcc3dd-5b07-4db3-9b4b-7fe0675b2ec9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.156073 Aug 04 22:23:19.925197 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 221/435] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:19 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:19.990346 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-20d2d105-44c1-4690-b4a1-bfa264a40917 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:19.990983 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-20d2d105-44c1-4690-b4a1-bfa264a40917 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:19.997818 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-20d2d105-44c1-4690-b4a1-bfa264a40917 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:19.998246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-20d2d105-44c1-4690-b4a1-bfa264a40917 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:19.998684 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-20d2d105-44c1-4690-b4a1-bfa264a40917 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:19.999427 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-20d2d105-44c1-4690-b4a1-bfa264a40917 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:19.999880 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-20d2d105-44c1-4690-b4a1-bfa264a40917 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:20.000311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-20d2d105-44c1-4690-b4a1-bfa264a40917 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:20.133754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-20d2d105-44c1-4690-b4a1-bfa264a40917 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:20.141687 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-20d2d105-44c1-4690-b4a1-bfa264a40917 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.155080 Aug 04 22:23:20.142253 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 215/436] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:19 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:20.944967 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-712bd1a7-78fb-4b64-8ae4-b3c80330dc19 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:20.945616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-712bd1a7-78fb-4b64-8ae4-b3c80330dc19 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:20.952552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-712bd1a7-78fb-4b64-8ae4-b3c80330dc19 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:20.953035 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-712bd1a7-78fb-4b64-8ae4-b3c80330dc19 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:20.953496 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-712bd1a7-78fb-4b64-8ae4-b3c80330dc19 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:20.954191 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-712bd1a7-78fb-4b64-8ae4-b3c80330dc19 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:20.954647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-712bd1a7-78fb-4b64-8ae4-b3c80330dc19 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:20.955072 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-712bd1a7-78fb-4b64-8ae4-b3c80330dc19 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:21.086441 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-712bd1a7-78fb-4b64-8ae4-b3c80330dc19 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:21.095021 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-712bd1a7-78fb-4b64-8ae4-b3c80330dc19 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.153894 Aug 04 22:23:21.095584 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 222/437] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:20 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:21.163438 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-95534fee-fa1b-42ea-9468-45eae12364e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:21.164045 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-95534fee-fa1b-42ea-9468-45eae12364e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:21.170746 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95534fee-fa1b-42ea-9468-45eae12364e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:21.171223 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95534fee-fa1b-42ea-9468-45eae12364e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:21.171651 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95534fee-fa1b-42ea-9468-45eae12364e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:21.172335 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95534fee-fa1b-42ea-9468-45eae12364e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:21.172783 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95534fee-fa1b-42ea-9468-45eae12364e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:21.173195 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95534fee-fa1b-42ea-9468-45eae12364e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:21.303654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-95534fee-fa1b-42ea-9468-45eae12364e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:21.312331 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-95534fee-fa1b-42ea-9468-45eae12364e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.152801 Aug 04 22:23:21.312907 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 216/438] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:21 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:22.116044 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-287a897d-dffe-4aa6-a131-304382fcf2a9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:22.116658 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-287a897d-dffe-4aa6-a131-304382fcf2a9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:22.123890 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-287a897d-dffe-4aa6-a131-304382fcf2a9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:22.124368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-287a897d-dffe-4aa6-a131-304382fcf2a9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:22.124799 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-287a897d-dffe-4aa6-a131-304382fcf2a9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:22.125516 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-287a897d-dffe-4aa6-a131-304382fcf2a9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:22.125971 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-287a897d-dffe-4aa6-a131-304382fcf2a9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:22.126396 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-287a897d-dffe-4aa6-a131-304382fcf2a9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:22.255738 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-287a897d-dffe-4aa6-a131-304382fcf2a9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:22.264279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-287a897d-dffe-4aa6-a131-304382fcf2a9 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1317 microversion: 2.1 time: 0.152025 Aug 04 22:23:22.265172 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 223/439] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:22 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:22.333790 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-335c7bb2-e9cc-49c9-b846-3db242ec4389 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:22.334412 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-335c7bb2-e9cc-49c9-b846-3db242ec4389 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:22.341705 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-335c7bb2-e9cc-49c9-b846-3db242ec4389 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:22.342103 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-335c7bb2-e9cc-49c9-b846-3db242ec4389 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:22.342538 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-335c7bb2-e9cc-49c9-b846-3db242ec4389 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:22.343225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-335c7bb2-e9cc-49c9-b846-3db242ec4389 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:22.343670 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-335c7bb2-e9cc-49c9-b846-3db242ec4389 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:22.344090 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-335c7bb2-e9cc-49c9-b846-3db242ec4389 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:22.490009 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-335c7bb2-e9cc-49c9-b846-3db242ec4389 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:22.497950 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-335c7bb2-e9cc-49c9-b846-3db242ec4389 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.167982 Aug 04 22:23:22.498519 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 217/440] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:22 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:23.284715 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3a3c62e1-0ebf-4da4-b574-146b8be17c56 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:23.285281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3a3c62e1-0ebf-4da4-b574-146b8be17c56 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:23.291263 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3a3c62e1-0ebf-4da4-b574-146b8be17c56 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:23.291748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3a3c62e1-0ebf-4da4-b574-146b8be17c56 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:23.292185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3a3c62e1-0ebf-4da4-b574-146b8be17c56 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:23.292875 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3a3c62e1-0ebf-4da4-b574-146b8be17c56 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:23.293535 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3a3c62e1-0ebf-4da4-b574-146b8be17c56 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:23.294031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3a3c62e1-0ebf-4da4-b574-146b8be17c56 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:23.423491 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3a3c62e1-0ebf-4da4-b574-146b8be17c56 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:23.430953 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3a3c62e1-0ebf-4da4-b574-146b8be17c56 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1499 microversion: 2.1 time: 0.150323 Aug 04 22:23:23.431557 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 224/441] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:23 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1499 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:23.519563 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-81063d0c-7458-4133-a08d-42fa9b920bcc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:23.520207 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-81063d0c-7458-4133-a08d-42fa9b920bcc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:23.526316 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81063d0c-7458-4133-a08d-42fa9b920bcc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:23.526788 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81063d0c-7458-4133-a08d-42fa9b920bcc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:23.527224 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81063d0c-7458-4133-a08d-42fa9b920bcc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:23.528636 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81063d0c-7458-4133-a08d-42fa9b920bcc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:23.529100 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81063d0c-7458-4133-a08d-42fa9b920bcc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:23.529559 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81063d0c-7458-4133-a08d-42fa9b920bcc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:23.683465 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-81063d0c-7458-4133-a08d-42fa9b920bcc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:23.700216 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-81063d0c-7458-4133-a08d-42fa9b920bcc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.184243 Aug 04 22:23:23.701827 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 218/442] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:23 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:24.722589 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-5a93ff01-8260-4b6c-aaea-715a531536a4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:24.723206 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-5a93ff01-8260-4b6c-aaea-715a531536a4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:24.729167 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5a93ff01-8260-4b6c-aaea-715a531536a4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:24.729690 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5a93ff01-8260-4b6c-aaea-715a531536a4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:24.730133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5a93ff01-8260-4b6c-aaea-715a531536a4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:24.731055 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5a93ff01-8260-4b6c-aaea-715a531536a4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:24.731523 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5a93ff01-8260-4b6c-aaea-715a531536a4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:24.731950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5a93ff01-8260-4b6c-aaea-715a531536a4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:24.866894 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-5a93ff01-8260-4b6c-aaea-715a531536a4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:24.875173 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-5a93ff01-8260-4b6c-aaea-715a531536a4 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.156400 Aug 04 22:23:24.875672 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 225/443] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:24 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:25.897318 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8256a9b9-2ee4-4fd6-981b-73fb03e532bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:25.897968 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8256a9b9-2ee4-4fd6-981b-73fb03e532bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:25.904892 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8256a9b9-2ee4-4fd6-981b-73fb03e532bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:25.905321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8256a9b9-2ee4-4fd6-981b-73fb03e532bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:25.905790 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8256a9b9-2ee4-4fd6-981b-73fb03e532bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:25.906485 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8256a9b9-2ee4-4fd6-981b-73fb03e532bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:25.906937 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8256a9b9-2ee4-4fd6-981b-73fb03e532bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:25.907361 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8256a9b9-2ee4-4fd6-981b-73fb03e532bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:25.911211 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:26.036866 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8256a9b9-2ee4-4fd6-981b-73fb03e532bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:26.045432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8256a9b9-2ee4-4fd6-981b-73fb03e532bb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.151848 Aug 04 22:23:26.046017 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 219/444] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:25 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:27.066667 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e58d9881-e1e3-4a08-9259-d1461fc17327 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:27.067214 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e58d9881-e1e3-4a08-9259-d1461fc17327 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:27.073194 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e58d9881-e1e3-4a08-9259-d1461fc17327 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:27.073707 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e58d9881-e1e3-4a08-9259-d1461fc17327 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:27.074145 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e58d9881-e1e3-4a08-9259-d1461fc17327 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:27.074869 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e58d9881-e1e3-4a08-9259-d1461fc17327 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:27.075815 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e58d9881-e1e3-4a08-9259-d1461fc17327 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:27.076242 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e58d9881-e1e3-4a08-9259-d1461fc17327 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:27.206098 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e58d9881-e1e3-4a08-9259-d1461fc17327 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:27.213555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e58d9881-e1e3-4a08-9259-d1461fc17327 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.150852 Aug 04 22:23:27.214115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 226/445] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:27 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:28.236845 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1da1859a-b607-41cb-b36b-f9eb38dd56ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:28.237513 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1da1859a-b607-41cb-b36b-f9eb38dd56ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:28.239821 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=50 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:28.245442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1da1859a-b607-41cb-b36b-f9eb38dd56ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:28.245930 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1da1859a-b607-41cb-b36b-f9eb38dd56ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:28.246374 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1da1859a-b607-41cb-b36b-f9eb38dd56ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:28.247775 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1da1859a-b607-41cb-b36b-f9eb38dd56ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:28.248242 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1da1859a-b607-41cb-b36b-f9eb38dd56ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:28.248672 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1da1859a-b607-41cb-b36b-f9eb38dd56ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:28.385748 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1da1859a-b607-41cb-b36b-f9eb38dd56ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:28.393837 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1da1859a-b607-41cb-b36b-f9eb38dd56ab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.160740 Aug 04 22:23:28.394570 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 220/446] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:28 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:29.415282 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7414beaa-dfe4-44df-852c-e0175489ebc6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:29.415923 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7414beaa-dfe4-44df-852c-e0175489ebc6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:29.422794 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7414beaa-dfe4-44df-852c-e0175489ebc6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:29.423284 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7414beaa-dfe4-44df-852c-e0175489ebc6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:29.423717 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7414beaa-dfe4-44df-852c-e0175489ebc6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:29.424445 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7414beaa-dfe4-44df-852c-e0175489ebc6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:29.424903 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7414beaa-dfe4-44df-852c-e0175489ebc6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:29.425326 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7414beaa-dfe4-44df-852c-e0175489ebc6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:29.632564 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7414beaa-dfe4-44df-852c-e0175489ebc6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:29.640290 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7414beaa-dfe4-44df-852c-e0175489ebc6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.228887 Aug 04 22:23:29.640954 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 227/447] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:29 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:30.523170 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3b98d184-3c41-461a-8551-077f4398bb85 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:30.523670 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3b98d184-3c41-461a-8551-077f4398bb85 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:30.529804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b98d184-3c41-461a-8551-077f4398bb85 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:30.530216 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b98d184-3c41-461a-8551-077f4398bb85 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:30.530641 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b98d184-3c41-461a-8551-077f4398bb85 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:30.531317 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b98d184-3c41-461a-8551-077f4398bb85 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:30.531761 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b98d184-3c41-461a-8551-077f4398bb85 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:30.532180 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b98d184-3c41-461a-8551-077f4398bb85 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:30.556066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3b98d184-3c41-461a-8551-077f4398bb85 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Going to try to terminate instance {{(pid=129196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:23:30.630049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3b98d184-3c41-461a-8551-077f4398bb85 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "DELETE /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 204 len: 0 microversion: 2.1 time: 0.110608 Aug 04 22:23:30.630820 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 221/448] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:23:30 2022] DELETE /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:23:30.639092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-87381bf0-e9af-4525-81e8-74a06e356e67 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:30.639910 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-87381bf0-e9af-4525-81e8-74a06e356e67 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:30.645705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-87381bf0-e9af-4525-81e8-74a06e356e67 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:30.646193 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-87381bf0-e9af-4525-81e8-74a06e356e67 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:30.646632 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-87381bf0-e9af-4525-81e8-74a06e356e67 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:30.647331 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-87381bf0-e9af-4525-81e8-74a06e356e67 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:30.647789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-87381bf0-e9af-4525-81e8-74a06e356e67 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:30.648215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-87381bf0-e9af-4525-81e8-74a06e356e67 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:30.662953 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-504929f7-f888-41a2-bb92-9ffc8c969243 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:30.663754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-504929f7-f888-41a2-bb92-9ffc8c969243 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:30.670408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-504929f7-f888-41a2-bb92-9ffc8c969243 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:30.670892 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-504929f7-f888-41a2-bb92-9ffc8c969243 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:30.671330 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-504929f7-f888-41a2-bb92-9ffc8c969243 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:30.672034 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-504929f7-f888-41a2-bb92-9ffc8c969243 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:30.672490 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-504929f7-f888-41a2-bb92-9ffc8c969243 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:30.672916 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-504929f7-f888-41a2-bb92-9ffc8c969243 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:30.778122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-87381bf0-e9af-4525-81e8-74a06e356e67 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:30.785664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-87381bf0-e9af-4525-81e8-74a06e356e67 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1505 microversion: 2.1 time: 0.150547 Aug 04 22:23:30.786294 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 228/449] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:30 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:30.805524 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-504929f7-f888-41a2-bb92-9ffc8c969243 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:30.814207 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-504929f7-f888-41a2-bb92-9ffc8c969243 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.155511 Aug 04 22:23:30.814775 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 222/450] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:30 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:31.807941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-36024526-4ae2-4bdb-b3e4-7fa3c90de2ee tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:31.808560 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-36024526-4ae2-4bdb-b3e4-7fa3c90de2ee tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:31.815450 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36024526-4ae2-4bdb-b3e4-7fa3c90de2ee tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:31.815941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36024526-4ae2-4bdb-b3e4-7fa3c90de2ee tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:31.816380 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36024526-4ae2-4bdb-b3e4-7fa3c90de2ee tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:31.817074 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36024526-4ae2-4bdb-b3e4-7fa3c90de2ee tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:31.817565 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36024526-4ae2-4bdb-b3e4-7fa3c90de2ee tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:31.817998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36024526-4ae2-4bdb-b3e4-7fa3c90de2ee tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:31.835044 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-444ddcae-b790-4950-a7cd-a669301a1871 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:31.835773 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-444ddcae-b790-4950-a7cd-a669301a1871 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:31.842302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-444ddcae-b790-4950-a7cd-a669301a1871 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:31.842893 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-444ddcae-b790-4950-a7cd-a669301a1871 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:31.843401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-444ddcae-b790-4950-a7cd-a669301a1871 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:31.844168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-444ddcae-b790-4950-a7cd-a669301a1871 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:31.844697 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-444ddcae-b790-4950-a7cd-a669301a1871 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:31.845195 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-444ddcae-b790-4950-a7cd-a669301a1871 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:31.986050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-36024526-4ae2-4bdb-b3e4-7fa3c90de2ee tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:31.993240 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-444ddcae-b790-4950-a7cd-a669301a1871 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:31.994221 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-36024526-4ae2-4bdb-b3e4-7fa3c90de2ee tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1505 microversion: 2.1 time: 0.190416 Aug 04 22:23:31.994798 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 229/451] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:31 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:32.008780 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-444ddcae-b790-4950-a7cd-a669301a1871 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.170282 Aug 04 22:23:32.008780 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 223/452] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:31 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:33.016803 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-845e04f7-203e-4640-951f-d4fba6539ebc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:33.017505 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-845e04f7-203e-4640-951f-d4fba6539ebc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:33.022737 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-39e0295b-bb93-4555-a2b5-b16a80545c88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:33.023322 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-39e0295b-bb93-4555-a2b5-b16a80545c88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:33.023993 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-845e04f7-203e-4640-951f-d4fba6539ebc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:33.024483 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-845e04f7-203e-4640-951f-d4fba6539ebc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:33.024927 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-845e04f7-203e-4640-951f-d4fba6539ebc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:33.025711 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-845e04f7-203e-4640-951f-d4fba6539ebc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:33.026170 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-845e04f7-203e-4640-951f-d4fba6539ebc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:33.026603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-845e04f7-203e-4640-951f-d4fba6539ebc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:33.030413 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-39e0295b-bb93-4555-a2b5-b16a80545c88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:33.030895 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-39e0295b-bb93-4555-a2b5-b16a80545c88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:33.031329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-39e0295b-bb93-4555-a2b5-b16a80545c88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:33.032023 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-39e0295b-bb93-4555-a2b5-b16a80545c88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:33.032483 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-39e0295b-bb93-4555-a2b5-b16a80545c88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:33.032903 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-39e0295b-bb93-4555-a2b5-b16a80545c88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:33.167628 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-845e04f7-203e-4640-951f-d4fba6539ebc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:33.172893 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-39e0295b-bb93-4555-a2b5-b16a80545c88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:33.175759 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-845e04f7-203e-4640-951f-d4fba6539ebc tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1505 microversion: 2.1 time: 0.163298 Aug 04 22:23:33.176421 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 224/453] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:33 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:33.180310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-39e0295b-bb93-4555-a2b5-b16a80545c88 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.161390 Aug 04 22:23:33.180859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 230/454] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:33 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:34.197213 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-94fe00a4-97b0-4a7b-bb83-730cfa85f95e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:34.197904 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-94fe00a4-97b0-4a7b-bb83-730cfa85f95e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:34.202060 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0f4069bf-060f-4991-a407-a76275e626fc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:34.202678 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0f4069bf-060f-4991-a407-a76275e626fc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:34.205393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94fe00a4-97b0-4a7b-bb83-730cfa85f95e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:34.205908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94fe00a4-97b0-4a7b-bb83-730cfa85f95e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:34.206365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94fe00a4-97b0-4a7b-bb83-730cfa85f95e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:34.207095 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94fe00a4-97b0-4a7b-bb83-730cfa85f95e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:34.207692 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94fe00a4-97b0-4a7b-bb83-730cfa85f95e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:34.208119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94fe00a4-97b0-4a7b-bb83-730cfa85f95e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:34.208495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f4069bf-060f-4991-a407-a76275e626fc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:34.208975 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f4069bf-060f-4991-a407-a76275e626fc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:34.209428 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f4069bf-060f-4991-a407-a76275e626fc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:34.210120 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f4069bf-060f-4991-a407-a76275e626fc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:34.210572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f4069bf-060f-4991-a407-a76275e626fc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:34.210995 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f4069bf-060f-4991-a407-a76275e626fc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:34.341876 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0f4069bf-060f-4991-a407-a76275e626fc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:34.345328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-94fe00a4-97b0-4a7b-bb83-730cfa85f95e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:34.349592 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0f4069bf-060f-4991-a407-a76275e626fc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.151976 Aug 04 22:23:34.350187 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 231/455] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:34 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:34.352947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-94fe00a4-97b0-4a7b-bb83-730cfa85f95e tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1505 microversion: 2.1 time: 0.159647 Aug 04 22:23:34.353655 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 225/456] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:34 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:35.371387 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e18ac0b4-23c5-401b-8a7f-2b6f6d5202f6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:35.372105 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e18ac0b4-23c5-401b-8a7f-2b6f6d5202f6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:35.375422 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ab849baa-7a9b-4689-a10c-03b1586997be tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:35.376039 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ab849baa-7a9b-4689-a10c-03b1586997be tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:35.378015 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e18ac0b4-23c5-401b-8a7f-2b6f6d5202f6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:35.378496 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e18ac0b4-23c5-401b-8a7f-2b6f6d5202f6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:35.378932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e18ac0b4-23c5-401b-8a7f-2b6f6d5202f6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:35.379622 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e18ac0b4-23c5-401b-8a7f-2b6f6d5202f6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:35.380070 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e18ac0b4-23c5-401b-8a7f-2b6f6d5202f6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:35.380488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e18ac0b4-23c5-401b-8a7f-2b6f6d5202f6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:35.382831 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab849baa-7a9b-4689-a10c-03b1586997be tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:35.383310 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab849baa-7a9b-4689-a10c-03b1586997be tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:35.383766 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab849baa-7a9b-4689-a10c-03b1586997be tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:35.384456 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab849baa-7a9b-4689-a10c-03b1586997be tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:35.384929 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab849baa-7a9b-4689-a10c-03b1586997be tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:35.385347 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab849baa-7a9b-4689-a10c-03b1586997be tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:35.515311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-ab849baa-7a9b-4689-a10c-03b1586997be tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:35.515586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e18ac0b4-23c5-401b-8a7f-2b6f6d5202f6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:35.523433 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ab849baa-7a9b-4689-a10c-03b1586997be tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1505 microversion: 2.1 time: 0.151803 Aug 04 22:23:35.524179 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 226/457] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:35 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:35.524593 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e18ac0b4-23c5-401b-8a7f-2b6f6d5202f6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.157355 Aug 04 22:23:35.525173 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 232/458] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:35 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:36.546408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5c050b7d-72de-4fff-ad43-f18be781c530 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:36.547005 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b1fd82c9-9a75-4dbf-a985-77a06f3a4657 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:36.547436 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5c050b7d-72de-4fff-ad43-f18be781c530 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:36.547555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b1fd82c9-9a75-4dbf-a985-77a06f3a4657 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:36.553891 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1fd82c9-9a75-4dbf-a985-77a06f3a4657 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:36.554341 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5c050b7d-72de-4fff-ad43-f18be781c530 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:36.554446 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1fd82c9-9a75-4dbf-a985-77a06f3a4657 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:36.554794 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1fd82c9-9a75-4dbf-a985-77a06f3a4657 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:36.554941 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5c050b7d-72de-4fff-ad43-f18be781c530 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:36.555250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5c050b7d-72de-4fff-ad43-f18be781c530 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:36.555483 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1fd82c9-9a75-4dbf-a985-77a06f3a4657 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:36.555931 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1fd82c9-9a75-4dbf-a985-77a06f3a4657 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:36.556049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5c050b7d-72de-4fff-ad43-f18be781c530 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:36.556383 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5c050b7d-72de-4fff-ad43-f18be781c530 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:36.556480 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1fd82c9-9a75-4dbf-a985-77a06f3a4657 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:36.556834 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5c050b7d-72de-4fff-ad43-f18be781c530 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:36.699228 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b1fd82c9-9a75-4dbf-a985-77a06f3a4657 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:36.708861 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b1fd82c9-9a75-4dbf-a985-77a06f3a4657 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.166874 Aug 04 22:23:36.709056 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5c050b7d-72de-4fff-ad43-f18be781c530 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:36.709565 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 233/459] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:36 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:36.718297 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5c050b7d-72de-4fff-ad43-f18be781c530 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1505 microversion: 2.1 time: 0.176693 Aug 04 22:23:36.718865 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 227/460] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:36 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:37.432506 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:23:37.432734 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Thu Aug 4 22:23:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:23:37.729769 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a03d845e-524e-4e0c-a2e9-73031cac1e89 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:37.730424 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a03d845e-524e-4e0c-a2e9-73031cac1e89 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:37.736594 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a03d845e-524e-4e0c-a2e9-73031cac1e89 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:37.737084 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a03d845e-524e-4e0c-a2e9-73031cac1e89 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:37.737549 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a03d845e-524e-4e0c-a2e9-73031cac1e89 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:37.738252 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a03d845e-524e-4e0c-a2e9-73031cac1e89 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:37.738715 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a03d845e-524e-4e0c-a2e9-73031cac1e89 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:37.739141 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a03d845e-524e-4e0c-a2e9-73031cac1e89 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:37.739488 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e4d2b143-3ec5-4ff1-9be0-bf8b22a3bfff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:37.740148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e4d2b143-3ec5-4ff1-9be0-bf8b22a3bfff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:37.747622 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e4d2b143-3ec5-4ff1-9be0-bf8b22a3bfff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:37.748103 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e4d2b143-3ec5-4ff1-9be0-bf8b22a3bfff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:37.748545 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e4d2b143-3ec5-4ff1-9be0-bf8b22a3bfff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:37.749251 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e4d2b143-3ec5-4ff1-9be0-bf8b22a3bfff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:37.749735 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e4d2b143-3ec5-4ff1-9be0-bf8b22a3bfff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:37.750162 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e4d2b143-3ec5-4ff1-9be0-bf8b22a3bfff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:37.876563 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a03d845e-524e-4e0c-a2e9-73031cac1e89 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:37.884130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a03d845e-524e-4e0c-a2e9-73031cac1e89 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.158274 Aug 04 22:23:37.884742 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 234/461] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:37 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:37.885050 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e4d2b143-3ec5-4ff1-9be0-bf8b22a3bfff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:37.894824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e4d2b143-3ec5-4ff1-9be0-bf8b22a3bfff tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1505 microversion: 2.1 time: 0.159199 Aug 04 22:23:37.895419 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 228/462] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:37 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:38.906915 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-5d0fd87c-1c61-4868-89c7-8dfa6f735e9c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:38.907529 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-5d0fd87c-1c61-4868-89c7-8dfa6f735e9c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:38.913633 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5d0fd87c-1c61-4868-89c7-8dfa6f735e9c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:38.914240 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5d0fd87c-1c61-4868-89c7-8dfa6f735e9c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:38.914680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5d0fd87c-1c61-4868-89c7-8dfa6f735e9c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:38.915396 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a2864068-49a4-45c7-8a17-e4b7290c58fb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:38.915816 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5d0fd87c-1c61-4868-89c7-8dfa6f735e9c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:38.915931 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5d0fd87c-1c61-4868-89c7-8dfa6f735e9c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:38.916010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a2864068-49a4-45c7-8a17-e4b7290c58fb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:38.916272 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5d0fd87c-1c61-4868-89c7-8dfa6f735e9c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:38.923004 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a2864068-49a4-45c7-8a17-e4b7290c58fb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:38.923489 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a2864068-49a4-45c7-8a17-e4b7290c58fb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:38.923933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a2864068-49a4-45c7-8a17-e4b7290c58fb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:38.924631 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a2864068-49a4-45c7-8a17-e4b7290c58fb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:38.925086 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a2864068-49a4-45c7-8a17-e4b7290c58fb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:38.925557 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a2864068-49a4-45c7-8a17-e4b7290c58fb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:39.050437 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-5d0fd87c-1c61-4868-89c7-8dfa6f735e9c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:39.058389 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-5d0fd87c-1c61-4868-89c7-8dfa6f735e9c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.155459 Aug 04 22:23:39.059915 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 235/463] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:38 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:39.068050 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a2864068-49a4-45c7-8a17-e4b7290c58fb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:39.074104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a2864068-49a4-45c7-8a17-e4b7290c58fb tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1505 microversion: 2.1 time: 0.162447 Aug 04 22:23:39.074862 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 229/464] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:38 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:40.080282 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f38dc5e6-cf2a-4702-a810-b304e501e4ff tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:40.080899 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f38dc5e6-cf2a-4702-a810-b304e501e4ff tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:40.086814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f38dc5e6-cf2a-4702-a810-b304e501e4ff tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:40.087292 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f38dc5e6-cf2a-4702-a810-b304e501e4ff tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:40.087723 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f38dc5e6-cf2a-4702-a810-b304e501e4ff tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:40.088442 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f38dc5e6-cf2a-4702-a810-b304e501e4ff tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:40.088895 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f38dc5e6-cf2a-4702-a810-b304e501e4ff tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:40.089315 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f38dc5e6-cf2a-4702-a810-b304e501e4ff tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:40.095446 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-db30a426-e9b6-4f2c-b963-4deea7ac9fc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:40.096114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-db30a426-e9b6-4f2c-b963-4deea7ac9fc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:40.102786 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-db30a426-e9b6-4f2c-b963-4deea7ac9fc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:40.103281 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-db30a426-e9b6-4f2c-b963-4deea7ac9fc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:40.103712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-db30a426-e9b6-4f2c-b963-4deea7ac9fc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:40.104406 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-db30a426-e9b6-4f2c-b963-4deea7ac9fc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:40.104865 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-db30a426-e9b6-4f2c-b963-4deea7ac9fc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:40.105276 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-db30a426-e9b6-4f2c-b963-4deea7ac9fc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:40.228735 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f38dc5e6-cf2a-4702-a810-b304e501e4ff tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:40.236244 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f38dc5e6-cf2a-4702-a810-b304e501e4ff tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.159815 Aug 04 22:23:40.236997 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 236/465] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:40 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:40.249778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-db30a426-e9b6-4f2c-b963-4deea7ac9fc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:40.257442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-db30a426-e9b6-4f2c-b963-4deea7ac9fc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1505 microversion: 2.1 time: 0.165900 Aug 04 22:23:40.258024 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 230/466] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:40 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:41.257462 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d47a07ac-b303-4a51-95a6-dc557839cb44 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:41.258019 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d47a07ac-b303-4a51-95a6-dc557839cb44 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:41.264457 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d47a07ac-b303-4a51-95a6-dc557839cb44 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:41.264944 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d47a07ac-b303-4a51-95a6-dc557839cb44 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:41.265383 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d47a07ac-b303-4a51-95a6-dc557839cb44 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:41.266096 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d47a07ac-b303-4a51-95a6-dc557839cb44 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:41.266554 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d47a07ac-b303-4a51-95a6-dc557839cb44 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:41.266986 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d47a07ac-b303-4a51-95a6-dc557839cb44 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:41.279357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6d355527-d65f-4819-ab10-930ecd0f4829 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:41.279960 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6d355527-d65f-4819-ab10-930ecd0f4829 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:41.286507 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6d355527-d65f-4819-ab10-930ecd0f4829 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:41.286980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6d355527-d65f-4819-ab10-930ecd0f4829 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:41.287408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6d355527-d65f-4819-ab10-930ecd0f4829 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:41.288099 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6d355527-d65f-4819-ab10-930ecd0f4829 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:41.288548 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6d355527-d65f-4819-ab10-930ecd0f4829 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:41.288959 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6d355527-d65f-4819-ab10-930ecd0f4829 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:41.403338 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d47a07ac-b303-4a51-95a6-dc557839cb44 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:41.405608 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=100 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:41.412390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d47a07ac-b303-4a51-95a6-dc557839cb44 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.158817 Aug 04 22:23:41.413148 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 237/467] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:41 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:41.422395 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6d355527-d65f-4819-ab10-930ecd0f4829 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:41.429815 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6d355527-d65f-4819-ab10-930ecd0f4829 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1505 microversion: 2.1 time: 0.154786 Aug 04 22:23:41.430375 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 231/468] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:41 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:42.432837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bd1fb31a-8db0-4f9c-b07e-ce5a791ca1c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:42.433510 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bd1fb31a-8db0-4f9c-b07e-ce5a791ca1c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:42.439387 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd1fb31a-8db0-4f9c-b07e-ce5a791ca1c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:42.439861 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd1fb31a-8db0-4f9c-b07e-ce5a791ca1c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:42.440285 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd1fb31a-8db0-4f9c-b07e-ce5a791ca1c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:42.440965 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd1fb31a-8db0-4f9c-b07e-ce5a791ca1c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:42.441437 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd1fb31a-8db0-4f9c-b07e-ce5a791ca1c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:42.441925 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bd1fb31a-8db0-4f9c-b07e-ce5a791ca1c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:42.451345 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b0135738-c9ce-4b9f-ac24-268a6cb7efc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:42.451965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b0135738-c9ce-4b9f-ac24-268a6cb7efc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:42.459482 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0135738-c9ce-4b9f-ac24-268a6cb7efc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:42.459980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0135738-c9ce-4b9f-ac24-268a6cb7efc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:42.460423 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0135738-c9ce-4b9f-ac24-268a6cb7efc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:42.461143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0135738-c9ce-4b9f-ac24-268a6cb7efc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:42.461625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0135738-c9ce-4b9f-ac24-268a6cb7efc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:42.462055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0135738-c9ce-4b9f-ac24-268a6cb7efc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:42.575205 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bd1fb31a-8db0-4f9c-b07e-ce5a791ca1c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:42.585150 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bd1fb31a-8db0-4f9c-b07e-ce5a791ca1c7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.156000 Aug 04 22:23:42.585767 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 238/469] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:42 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:42.602439 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b0135738-c9ce-4b9f-ac24-268a6cb7efc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:42.610368 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b0135738-c9ce-4b9f-ac24-268a6cb7efc2 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1505 microversion: 2.1 time: 0.163242 Aug 04 22:23:42.610950 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 232/470] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:42 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:43.609297 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9881b1ab-0f33-4f74-81df-5e0d6d03bc58 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:43.609943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-9881b1ab-0f33-4f74-81df-5e0d6d03bc58 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:43.616360 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9881b1ab-0f33-4f74-81df-5e0d6d03bc58 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:43.616849 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9881b1ab-0f33-4f74-81df-5e0d6d03bc58 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:43.617574 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9881b1ab-0f33-4f74-81df-5e0d6d03bc58 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:43.618277 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9881b1ab-0f33-4f74-81df-5e0d6d03bc58 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:43.618738 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9881b1ab-0f33-4f74-81df-5e0d6d03bc58 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:43.619170 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9881b1ab-0f33-4f74-81df-5e0d6d03bc58 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:43.630877 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-cccd3a04-ea1a-42a3-bf16-6f4230ba6f6f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:43.631482 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-cccd3a04-ea1a-42a3-bf16-6f4230ba6f6f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:43.637831 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cccd3a04-ea1a-42a3-bf16-6f4230ba6f6f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:43.638312 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cccd3a04-ea1a-42a3-bf16-6f4230ba6f6f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:43.638743 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cccd3a04-ea1a-42a3-bf16-6f4230ba6f6f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:43.639425 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cccd3a04-ea1a-42a3-bf16-6f4230ba6f6f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:43.639871 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cccd3a04-ea1a-42a3-bf16-6f4230ba6f6f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:43.640289 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cccd3a04-ea1a-42a3-bf16-6f4230ba6f6f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:43.756202 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9881b1ab-0f33-4f74-81df-5e0d6d03bc58 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:43.763828 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9881b1ab-0f33-4f74-81df-5e0d6d03bc58 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1514 microversion: 2.1 time: 0.158949 Aug 04 22:23:43.764391 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 239/471] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:43 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:43.788013 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-cccd3a04-ea1a-42a3-bf16-6f4230ba6f6f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:43.795952 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-cccd3a04-ea1a-42a3-bf16-6f4230ba6f6f tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1505 microversion: 2.1 time: 0.168864 Aug 04 22:23:43.796515 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 233/472] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:43 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:44.422035 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-b4485a83-2e5c-4407-b84d-83211ec4b94a req-850a8012-e089-4d37-b2ac-1ad8f18821fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe4f98c-ef1c-4ff7-886c-aa5f6fba4060", "name": "network-vif-unplugged", "status": "completed", "tag": "9b827747-2bc5-47da-a103-19ea8f8e7429"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:23:44.432028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-b4485a83-2e5c-4407-b84d-83211ec4b94a req-850a8012-e089-4d37-b2ac-1ad8f18821fc service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:44.432772 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-b4485a83-2e5c-4407-b84d-83211ec4b94a req-850a8012-e089-4d37-b2ac-1ad8f18821fc service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:44.433219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-b4485a83-2e5c-4407-b84d-83211ec4b94a req-850a8012-e089-4d37-b2ac-1ad8f18821fc service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:44.444890 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-b4485a83-2e5c-4407-b84d-83211ec4b94a req-850a8012-e089-4d37-b2ac-1ad8f18821fc service nova] Creating event network-vif-unplugged:9b827747-2bc5-47da-a103-19ea8f8e7429 for instance abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 on hv-cinder-85221 Aug 04 22:23:44.450194 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-b4485a83-2e5c-4407-b84d-83211ec4b94a req-850a8012-e089-4d37-b2ac-1ad8f18821fc service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032775 Aug 04 22:23:44.451614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 240/473] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:23:44.785802 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b3cce9a7-2d1a-4a9f-82ee-e8a104e8f079 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:44.786411 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b3cce9a7-2d1a-4a9f-82ee-e8a104e8f079 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:44.792679 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3cce9a7-2d1a-4a9f-82ee-e8a104e8f079 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:44.793162 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3cce9a7-2d1a-4a9f-82ee-e8a104e8f079 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:44.793628 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3cce9a7-2d1a-4a9f-82ee-e8a104e8f079 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:44.794308 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3cce9a7-2d1a-4a9f-82ee-e8a104e8f079 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:44.794802 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3cce9a7-2d1a-4a9f-82ee-e8a104e8f079 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:44.795221 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3cce9a7-2d1a-4a9f-82ee-e8a104e8f079 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:44.799137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:44.817206 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b8f0d92b-73bf-451e-9b7e-8753ca2afcf0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:44.817942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b8f0d92b-73bf-451e-9b7e-8753ca2afcf0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:44.824163 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b8f0d92b-73bf-451e-9b7e-8753ca2afcf0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:44.824646 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b8f0d92b-73bf-451e-9b7e-8753ca2afcf0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:44.825083 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b8f0d92b-73bf-451e-9b7e-8753ca2afcf0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:44.827042 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b8f0d92b-73bf-451e-9b7e-8753ca2afcf0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:44.827502 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b8f0d92b-73bf-451e-9b7e-8753ca2afcf0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:44.827930 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b8f0d92b-73bf-451e-9b7e-8753ca2afcf0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:44.927483 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b3cce9a7-2d1a-4a9f-82ee-e8a104e8f079 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:44.935234 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b3cce9a7-2d1a-4a9f-82ee-e8a104e8f079 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1520 microversion: 2.1 time: 0.153236 Aug 04 22:23:44.935770 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 234/474] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:44 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:44.962016 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b8f0d92b-73bf-451e-9b7e-8753ca2afcf0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:44.971564 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b8f0d92b-73bf-451e-9b7e-8753ca2afcf0 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1505 microversion: 2.1 time: 0.158665 Aug 04 22:23:44.972130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 241/475] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:44 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:23:45.745708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-d26fbbbf-76b6-47b2-948c-f09b69a32fbb req-27c00579-6952-4211-aca0-8709ea98362b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe4f98c-ef1c-4ff7-886c-aa5f6fba4060", "name": "network-vif-deleted", "tag": "9b827747-2bc5-47da-a103-19ea8f8e7429"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:23:45.756273 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-d26fbbbf-76b6-47b2-948c-f09b69a32fbb req-27c00579-6952-4211-aca0-8709ea98362b service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:45.756753 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-d26fbbbf-76b6-47b2-948c-f09b69a32fbb req-27c00579-6952-4211-aca0-8709ea98362b service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:45.757182 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-d26fbbbf-76b6-47b2-948c-f09b69a32fbb req-27c00579-6952-4211-aca0-8709ea98362b service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:45.768847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-d26fbbbf-76b6-47b2-948c-f09b69a32fbb req-27c00579-6952-4211-aca0-8709ea98362b service nova] Creating event network-vif-deleted:9b827747-2bc5-47da-a103-19ea8f8e7429 for instance abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 on hv-cinder-85221 Aug 04 22:23:45.773794 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-d26fbbbf-76b6-47b2-948c-f09b69a32fbb req-27c00579-6952-4211-aca0-8709ea98362b service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031945 Aug 04 22:23:45.774495 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 235/476] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:23:45.992730 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:45.993279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:45.999153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:45.999639 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:46.000075 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:46.000774 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:46.001233 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:46.001704 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:46.032452 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:46.032930 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:46.033354 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:46.033815 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.objects.instance [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lazy-loading 'fault' on Instance uuid abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 {{(pid=129197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:23:46.080062 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9542521c42b34769a236eb6f268c5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9017e927b016427aa84b863e0e2a86a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:46.087511 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6f72979d-a02f-41ff-a131-9fad3351d0e3 tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 200 len: 1307 microversion: 2.1 time: 0.099097 Aug 04 22:23:46.088069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 242/477] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:45 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:47.115654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-32c12148-b527-4bea-8b02-7ae3a7886fad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:47.116794 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-32c12148-b527-4bea-8b02-7ae3a7886fad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] [instance: abe4f98c-ef1c-4ff7-886c-aa5f6fba4060] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:47.126541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-32c12148-b527-4bea-8b02-7ae3a7886fad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:47.127304 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-32c12148-b527-4bea-8b02-7ae3a7886fad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:47.127962 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-32c12148-b527-4bea-8b02-7ae3a7886fad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:47.129126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-32c12148-b527-4bea-8b02-7ae3a7886fad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:47.129850 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-32c12148-b527-4bea-8b02-7ae3a7886fad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:47.130467 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-32c12148-b527-4bea-8b02-7ae3a7886fad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:47.144850 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-32c12148-b527-4bea-8b02-7ae3a7886fad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] HTTP exception thrown: Instance abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 could not be found. Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-32c12148-b527-4bea-8b02-7ae3a7886fad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Request method failure captured: Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 HTTP/1.1 Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EZ2u-wxbicuP4P_GgELuDpB7UU7-MTacwrtcjy1xH82mLlQHPraXG1eI2DCqr2u2yDy7FT1c7FlVtqLc7CdH0QVr2BPVJHGPfGHGDyMPmpQijd2KUcfiDQUUu1fTdSdFyhn2YGR4qtfvwFkoOwTeLZppaylkaLeJpMd3K22nwjQnfY Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 9017e927b016427aa84b863e0e2a86a4 Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-VolumesActionsTest-1057466123 Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:23:47.146530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:23:47.148101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/9017e927b016427aa84b863e0e2a86a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_9017e927b016427aa84b863e0e2a86a4", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/9017e927b016427aa84b863e0e2a86a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/9017e927b016427aa84b863e0e2a86a4"}]}] Aug 04 22:23:47.148101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-VolumesActionsTest-1057466123 Aug 04 22:23:47.148101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 9017e927b016427aa84b863e0e2a86a4 Aug 04 22:23:47.148101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-VolumesActionsTest-1057466123 Aug 04 22:23:47.148101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-VolumesActionsTest-1057466123-project Aug 04 22:23:47.148101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:23:47.148101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:23:47.148101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 9542521c42b34769a236eb6f268c5358 Aug 04 22:23:47.148101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-VolumesActionsTest-1057466123-project Aug 04 22:23:47.148101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:23:47.148101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 could not be found. Aug 04 22:23:47.148101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'abe4f98c-ef1c-4ff7-886c-aa5f6fba4060'} Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 could not be found. Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:23:47.148912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 could not be found. Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 could not be found. Aug 04 22:23:47.150231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:23:47.151550 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-32c12148-b527-4bea-8b02-7ae3a7886fad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] Returning 404 to user: Instance abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:23:47.151550 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-32c12148-b527-4bea-8b02-7ae3a7886fad tempest-VolumesActionsTest-1057466123 tempest-VolumesActionsTest-1057466123-project] 10.222.0.109 "GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060" status: 404 len: 111 microversion: 2.1 time: 0.038951 Aug 04 22:23:47.151550 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 236/478] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:47 2022] GET /compute/v2.1/servers/abe4f98c-ef1c-4ff7-886c-aa5f6fba4060 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:23:51.569299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3bb6fa40-dc36-4151-8dfa-c1d40fdb94b9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Action: 'create', calling method: .version_select at 0x7fe7b1a843a0>, body: {"keypair": {"name": "tempest-keypair-781171814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0sb2GnsAt12mWxXJCj6ko2glwqn0Z02c6sOOYbzYpFEjpN4CSi29OAqq5DkOQTHcJAdtlM8Fclud044LEPbyiUYdJHeWaJfE8dw8QZS85pEu8r79KzaNLgaeBDyTtMhg=="}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:23:51.574974 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=52 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:51.586451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-3bb6fa40-dc36-4151-8dfa-c1d40fdb94b9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Getting quotas for project 5116986e2edc4b5c92da0b77a497910a. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:23:51.590644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-3bb6fa40-dc36-4151-8dfa-c1d40fdb94b9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Getting quotas for user f3dab07011da408c97ed90d58f2c155b and project 5116986e2edc4b5c92da0b77a497910a. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:23:51.615597 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3bb6fa40-dc36-4151-8dfa-c1d40fdb94b9 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050141 Aug 04 22:23:51.616220 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 243/479] 10.222.0.109 () {60 vars in 1164 bytes} [Thu Aug 4 22:23:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:23:52.914187 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-193369183", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da0530bc-1426-4242-a934-503023b6de69"}], "security_groups": [{"name": "tempest-securitygroup--1663778852"}], "key_name": "tempest-keypair-781171814", "user_data": "}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:23:53.018290 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.network.neutron [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] validate_networks() for [('da0530bc-1426-4242-a934-503023b6de69', None, None, None, None, None)] {{(pid=129196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:23:53.403717 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Flavor limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:23:53.404140 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Image limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:23:53.404686 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Flavor pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:23:53.405043 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Image pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:23:53.405482 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:23:53.414236 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:53.414742 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:53.415178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:53.415932 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:53.416354 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:53.416779 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:53.433682 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Getting quotas for project 5116986e2edc4b5c92da0b77a497910a. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:23:53.437608 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Getting quotas for user f3dab07011da408c97ed90d58f2c155b and project 5116986e2edc4b5c92da0b77a497910a. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:23:53.448411 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Going to run 1 instances... {{(pid=129196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:23:53.450742 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:23:53.496696 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5829cd52-ee85-43a1-8821-3db53c9ddc47 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 0.586837 Aug 04 22:23:53.497340 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 237/480] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:23:52 2022] POST /compute/v2.1/servers => generated 411 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:23:53.508307 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-424906fa-e6d6-461f-9bbe-eff87b336772 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:53.509060 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-424906fa-e6d6-461f-9bbe-eff87b336772 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:53.567389 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-424906fa-e6d6-461f-9bbe-eff87b336772 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:53.574418 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-424906fa-e6d6-461f-9bbe-eff87b336772 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1248 microversion: 2.1 time: 0.070098 Aug 04 22:23:53.575555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 244/481] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:53 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:54.595975 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-96c8489a-e2d4-4230-b6d1-f5b16b9f5eec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:54.596620 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-96c8489a-e2d4-4230-b6d1-f5b16b9f5eec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:54.604944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-96c8489a-e2d4-4230-b6d1-f5b16b9f5eec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:54.605550 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-96c8489a-e2d4-4230-b6d1-f5b16b9f5eec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:54.606396 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-96c8489a-e2d4-4230-b6d1-f5b16b9f5eec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:54.607095 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-96c8489a-e2d4-4230-b6d1-f5b16b9f5eec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:54.607554 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-96c8489a-e2d4-4230-b6d1-f5b16b9f5eec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:54.607985 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-96c8489a-e2d4-4230-b6d1-f5b16b9f5eec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:54.669722 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-96c8489a-e2d4-4230-b6d1-f5b16b9f5eec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:54.677109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-96c8489a-e2d4-4230-b6d1-f5b16b9f5eec tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1252 microversion: 2.1 time: 0.085544 Aug 04 22:23:54.677700 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 238/482] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:54 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1252 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:55.698225 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bc6d4c47-e906-4f91-962a-07dbf78b26ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:55.698847 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bc6d4c47-e906-4f91-962a-07dbf78b26ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:55.705888 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc6d4c47-e906-4f91-962a-07dbf78b26ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:55.706382 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc6d4c47-e906-4f91-962a-07dbf78b26ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:55.706823 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc6d4c47-e906-4f91-962a-07dbf78b26ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:55.707523 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc6d4c47-e906-4f91-962a-07dbf78b26ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:55.707984 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc6d4c47-e906-4f91-962a-07dbf78b26ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:55.708414 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc6d4c47-e906-4f91-962a-07dbf78b26ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:55.770631 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bc6d4c47-e906-4f91-962a-07dbf78b26ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:55.778097 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bc6d4c47-e906-4f91-962a-07dbf78b26ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1252 microversion: 2.1 time: 0.083727 Aug 04 22:23:55.778667 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 245/483] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:55 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1252 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:56.800938 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-634820c6-b151-472e-a618-1058708b5d95 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:56.802044 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-634820c6-b151-472e-a618-1058708b5d95 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:56.812307 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-634820c6-b151-472e-a618-1058708b5d95 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:56.812796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-634820c6-b151-472e-a618-1058708b5d95 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:56.813982 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-634820c6-b151-472e-a618-1058708b5d95 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:56.815241 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-634820c6-b151-472e-a618-1058708b5d95 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:56.815767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-634820c6-b151-472e-a618-1058708b5d95 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:56.816837 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-634820c6-b151-472e-a618-1058708b5d95 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:56.881444 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-634820c6-b151-472e-a618-1058708b5d95 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:56.889149 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-634820c6-b151-472e-a618-1058708b5d95 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1306 microversion: 2.1 time: 0.094050 Aug 04 22:23:56.889705 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 239/484] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:56 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:57.914747 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2489ebfc-cccd-4d13-8ff2-58f0b59a2569 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:57.915972 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2489ebfc-cccd-4d13-8ff2-58f0b59a2569 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:57.925589 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2489ebfc-cccd-4d13-8ff2-58f0b59a2569 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:57.926418 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2489ebfc-cccd-4d13-8ff2-58f0b59a2569 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:57.927019 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2489ebfc-cccd-4d13-8ff2-58f0b59a2569 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:57.927905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2489ebfc-cccd-4d13-8ff2-58f0b59a2569 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:57.928522 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2489ebfc-cccd-4d13-8ff2-58f0b59a2569 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:57.930728 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2489ebfc-cccd-4d13-8ff2-58f0b59a2569 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:58.408433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2489ebfc-cccd-4d13-8ff2-58f0b59a2569 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:58.424001 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2489ebfc-cccd-4d13-8ff2-58f0b59a2569 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1374 microversion: 2.1 time: 0.517326 Aug 04 22:23:58.427641 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 246/485] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:57 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1374 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:23:58.751815 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-2c964f18-e6cc-4c22-9123-044999e250f7 req-031c127d-b1cc-4785-b161-de9fb4c8a10d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cca04a9-f894-43cf-b1d6-009292cdbcbb", "tag": "12d64262-0acf-4b1f-8905-8c5d540e11ec"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:23:58.761522 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:58.776466 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-2c964f18-e6cc-4c22-9123-044999e250f7 req-031c127d-b1cc-4785-b161-de9fb4c8a10d service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:58.779663 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-2c964f18-e6cc-4c22-9123-044999e250f7 req-031c127d-b1cc-4785-b161-de9fb4c8a10d service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:58.783090 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-2c964f18-e6cc-4c22-9123-044999e250f7 req-031c127d-b1cc-4785-b161-de9fb4c8a10d service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:58.811878 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-2c964f18-e6cc-4c22-9123-044999e250f7 req-031c127d-b1cc-4785-b161-de9fb4c8a10d service nova] Creating event network-changed:12d64262-0acf-4b1f-8905-8c5d540e11ec for instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb on hv-cinder-85221 Aug 04 22:23:58.824594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-2c964f18-e6cc-4c22-9123-044999e250f7 req-031c127d-b1cc-4785-b161-de9fb4c8a10d service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077482 Aug 04 22:23:58.826121 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 240/486] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:23:59.445389 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7a51a034-cf2d-4e2e-8ae7-e74401bca62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:23:59.446817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7a51a034-cf2d-4e2e-8ae7-e74401bca62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:23:59.453154 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7a51a034-cf2d-4e2e-8ae7-e74401bca62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:59.454687 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7a51a034-cf2d-4e2e-8ae7-e74401bca62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:59.455304 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7a51a034-cf2d-4e2e-8ae7-e74401bca62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:59.456210 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7a51a034-cf2d-4e2e-8ae7-e74401bca62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:23:59.456824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7a51a034-cf2d-4e2e-8ae7-e74401bca62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:23:59.457395 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7a51a034-cf2d-4e2e-8ae7-e74401bca62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:23:59.683246 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7a51a034-cf2d-4e2e-8ae7-e74401bca62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:23:59.692067 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7a51a034-cf2d-4e2e-8ae7-e74401bca62b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1374 microversion: 2.1 time: 0.250551 Aug 04 22:23:59.706111 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 247/487] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:23:59 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1374 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:00.713365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6b1d7815-e5b2-49c5-ad1f-d157316d496a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:00.714990 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6b1d7815-e5b2-49c5-ad1f-d157316d496a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:00.726771 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b1d7815-e5b2-49c5-ad1f-d157316d496a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:00.728749 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b1d7815-e5b2-49c5-ad1f-d157316d496a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:00.729309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b1d7815-e5b2-49c5-ad1f-d157316d496a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:00.730170 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b1d7815-e5b2-49c5-ad1f-d157316d496a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:00.732675 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b1d7815-e5b2-49c5-ad1f-d157316d496a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:00.733354 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b1d7815-e5b2-49c5-ad1f-d157316d496a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:00.935331 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6b1d7815-e5b2-49c5-ad1f-d157316d496a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:00.948000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6b1d7815-e5b2-49c5-ad1f-d157316d496a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1374 microversion: 2.1 time: 0.239585 Aug 04 22:24:00.954281 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 241/488] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:00 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1374 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:01.975986 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a6184a95-dd6a-4d65-a662-da77e22edc35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:01.977200 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a6184a95-dd6a-4d65-a662-da77e22edc35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:01.984476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6184a95-dd6a-4d65-a662-da77e22edc35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:01.985956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6184a95-dd6a-4d65-a662-da77e22edc35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:01.986405 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6184a95-dd6a-4d65-a662-da77e22edc35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:01.987171 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6184a95-dd6a-4d65-a662-da77e22edc35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:01.987631 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6184a95-dd6a-4d65-a662-da77e22edc35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:01.988057 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a6184a95-dd6a-4d65-a662-da77e22edc35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:02.213638 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a6184a95-dd6a-4d65-a662-da77e22edc35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:02.234404 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a6184a95-dd6a-4d65-a662-da77e22edc35 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1374 microversion: 2.1 time: 0.262244 Aug 04 22:24:02.235910 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 248/489] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:01 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1374 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:03.256910 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-2a0ee7d7-2eb4-499b-ba01-20a1fe88d8a1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:03.257590 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-2a0ee7d7-2eb4-499b-ba01-20a1fe88d8a1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:03.271909 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2a0ee7d7-2eb4-499b-ba01-20a1fe88d8a1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:03.272668 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2a0ee7d7-2eb4-499b-ba01-20a1fe88d8a1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:03.273110 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2a0ee7d7-2eb4-499b-ba01-20a1fe88d8a1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:03.273923 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2a0ee7d7-2eb4-499b-ba01-20a1fe88d8a1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:03.274381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2a0ee7d7-2eb4-499b-ba01-20a1fe88d8a1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:03.274813 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2a0ee7d7-2eb4-499b-ba01-20a1fe88d8a1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:03.423931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2a0ee7d7-2eb4-499b-ba01-20a1fe88d8a1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:03.426254 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:03.433663 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-2a0ee7d7-2eb4-499b-ba01-20a1fe88d8a1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1374 microversion: 2.1 time: 0.180479 Aug 04 22:24:03.434242 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 242/490] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:03 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:04.460853 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f0c49e9f-e2f3-44a4-8a91-29282935eaf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:04.462140 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f0c49e9f-e2f3-44a4-8a91-29282935eaf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:04.465435 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=6 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:04.469980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f0c49e9f-e2f3-44a4-8a91-29282935eaf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:04.470731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f0c49e9f-e2f3-44a4-8a91-29282935eaf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:04.471263 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f0c49e9f-e2f3-44a4-8a91-29282935eaf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:04.472127 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f0c49e9f-e2f3-44a4-8a91-29282935eaf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:04.472667 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f0c49e9f-e2f3-44a4-8a91-29282935eaf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:04.473192 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f0c49e9f-e2f3-44a4-8a91-29282935eaf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:04.661663 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f0c49e9f-e2f3-44a4-8a91-29282935eaf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:04.670130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f0c49e9f-e2f3-44a4-8a91-29282935eaf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1374 microversion: 2.1 time: 0.213198 Aug 04 22:24:04.671421 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 249/491] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:04 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1374 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:05.696951 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-daf2f5db-5979-4328-921e-2ce22c53bd4e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:05.697650 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-daf2f5db-5979-4328-921e-2ce22c53bd4e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:05.700882 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=6 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:05.724855 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-daf2f5db-5979-4328-921e-2ce22c53bd4e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:05.726076 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-daf2f5db-5979-4328-921e-2ce22c53bd4e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:05.727974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-daf2f5db-5979-4328-921e-2ce22c53bd4e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:05.730079 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-daf2f5db-5979-4328-921e-2ce22c53bd4e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:05.731742 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-daf2f5db-5979-4328-921e-2ce22c53bd4e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:05.732280 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-daf2f5db-5979-4328-921e-2ce22c53bd4e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:05.919111 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-daf2f5db-5979-4328-921e-2ce22c53bd4e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:05.927095 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-daf2f5db-5979-4328-921e-2ce22c53bd4e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1374 microversion: 2.1 time: 0.234310 Aug 04 22:24:05.927767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 243/492] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:05 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1374 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:06.951797 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f3370bf6-19c7-4ce2-a27e-764d0dc547c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:06.954501 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f3370bf6-19c7-4ce2-a27e-764d0dc547c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:06.974929 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f3370bf6-19c7-4ce2-a27e-764d0dc547c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:06.987114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f3370bf6-19c7-4ce2-a27e-764d0dc547c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:06.987114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f3370bf6-19c7-4ce2-a27e-764d0dc547c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:06.987114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f3370bf6-19c7-4ce2-a27e-764d0dc547c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:06.987114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f3370bf6-19c7-4ce2-a27e-764d0dc547c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:06.987497 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f3370bf6-19c7-4ce2-a27e-764d0dc547c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:07.059245 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1879928174", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452"}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:24:07.268002 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.network.neutron [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] validate_networks() for None {{(pid=129196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:24:07.347211 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f3370bf6-19c7-4ce2-a27e-764d0dc547c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:07.356007 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f3370bf6-19c7-4ce2-a27e-764d0dc547c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1374 microversion: 2.1 time: 0.408038 Aug 04 22:24:07.360237 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 250/493] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:06 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1374 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:07.727472 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Flavor limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:24:07.728211 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Image limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:24:07.728848 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Flavor pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:24:07.729502 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Image pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:24:07.730093 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:24:07.742212 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:07.742697 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:07.743122 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:07.744320 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:07.745291 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:07.745900 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:07.776167 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Getting quotas for project 8cfbac5e5eab4e719af887179d6bcea8. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:24:07.786067 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Getting quotas for user 35858dc56fdf4661a8aaffad520fc96f and project 8cfbac5e5eab4e719af887179d6bcea8. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:24:07.801022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Going to run 1 instances... {{(pid=129196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:24:07.804336 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:24:07.892690 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-872c28b1-42fa-4ad2-9592-b55f89961da9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.840983 Aug 04 22:24:07.893641 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 244/494] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:24:07 2022] POST /compute/v2.1/servers => generated 382 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 04 22:24:07.905085 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-8b883e26-e651-4370-b119-a5396d73a772 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:07.906703 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-8b883e26-e651-4370-b119-a5396d73a772 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:08.066996 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8b883e26-e651-4370-b119-a5396d73a772 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:08.079600 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-8b883e26-e651-4370-b119-a5396d73a772 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1219 microversion: 2.1 time: 0.175224 Aug 04 22:24:08.081535 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 251/495] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:07 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1219 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:24:08.384065 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7d61f4c7-2989-49df-b867-cffb7fe58e33 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:08.384685 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7d61f4c7-2989-49df-b867-cffb7fe58e33 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:08.418139 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d61f4c7-2989-49df-b867-cffb7fe58e33 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:08.419959 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d61f4c7-2989-49df-b867-cffb7fe58e33 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:08.420451 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d61f4c7-2989-49df-b867-cffb7fe58e33 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:08.424325 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d61f4c7-2989-49df-b867-cffb7fe58e33 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:08.427056 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d61f4c7-2989-49df-b867-cffb7fe58e33 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:08.429037 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d61f4c7-2989-49df-b867-cffb7fe58e33 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:09.106440 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f59743da-ff5e-4e1d-88e5-6913ce3598d0 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:09.107647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f59743da-ff5e-4e1d-88e5-6913ce3598d0 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:09.124925 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f59743da-ff5e-4e1d-88e5-6913ce3598d0 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:09.125548 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f59743da-ff5e-4e1d-88e5-6913ce3598d0 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:09.125986 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f59743da-ff5e-4e1d-88e5-6913ce3598d0 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:09.137721 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f59743da-ff5e-4e1d-88e5-6913ce3598d0 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:09.143990 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f59743da-ff5e-4e1d-88e5-6913ce3598d0 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:09.144690 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f59743da-ff5e-4e1d-88e5-6913ce3598d0 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:09.280227 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7d61f4c7-2989-49df-b867-cffb7fe58e33 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:09.289079 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7d61f4c7-2989-49df-b867-cffb7fe58e33 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1374 microversion: 2.1 time: 0.910408 Aug 04 22:24:09.290108 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 245/496] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:08 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1374 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:09.304438 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f59743da-ff5e-4e1d-88e5-6913ce3598d0 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:09.319845 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f59743da-ff5e-4e1d-88e5-6913ce3598d0 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1215 microversion: 2.1 time: 0.220495 Aug 04 22:24:09.321568 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 252/497] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:09 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1215 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:10.326066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ba61123d-be46-4088-b30a-9472013ad0fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:10.327970 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ba61123d-be46-4088-b30a-9472013ad0fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:10.348600 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0bd0a185-180f-453f-9f10-6c74c811f8d9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:10.350584 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0bd0a185-180f-453f-9f10-6c74c811f8d9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:10.360755 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ba61123d-be46-4088-b30a-9472013ad0fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:10.361623 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ba61123d-be46-4088-b30a-9472013ad0fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:10.364220 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ba61123d-be46-4088-b30a-9472013ad0fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:10.367205 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ba61123d-be46-4088-b30a-9472013ad0fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:10.368662 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ba61123d-be46-4088-b30a-9472013ad0fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:10.369944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ba61123d-be46-4088-b30a-9472013ad0fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:10.375241 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0bd0a185-180f-453f-9f10-6c74c811f8d9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:10.376429 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0bd0a185-180f-453f-9f10-6c74c811f8d9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:10.377057 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0bd0a185-180f-453f-9f10-6c74c811f8d9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:10.380278 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0bd0a185-180f-453f-9f10-6c74c811f8d9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:10.381013 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0bd0a185-180f-453f-9f10-6c74c811f8d9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:10.381657 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0bd0a185-180f-453f-9f10-6c74c811f8d9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:10.646924 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0bd0a185-180f-453f-9f10-6c74c811f8d9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:10.658817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0bd0a185-180f-453f-9f10-6c74c811f8d9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1277 microversion: 2.1 time: 0.316857 Aug 04 22:24:10.673590 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 253/498] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:10 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1277 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:10.744464 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-ba61123d-be46-4088-b30a-9472013ad0fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:10.757447 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ba61123d-be46-4088-b30a-9472013ad0fd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1374 microversion: 2.1 time: 0.437455 Aug 04 22:24:10.758467 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 246/499] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:10 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1374 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:11.245899 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-84729e68-7899-4fdc-b2ac-186cc747ba9f req-32db1ec7-2786-411d-a852-6d27855fb930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cca04a9-f894-43cf-b1d6-009292cdbcbb", "name": "network-vif-plugged", "status": "completed", "tag": "12d64262-0acf-4b1f-8905-8c5d540e11ec"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:24:11.291842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-84729e68-7899-4fdc-b2ac-186cc747ba9f req-32db1ec7-2786-411d-a852-6d27855fb930 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:11.291842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-84729e68-7899-4fdc-b2ac-186cc747ba9f req-32db1ec7-2786-411d-a852-6d27855fb930 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:11.291842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-84729e68-7899-4fdc-b2ac-186cc747ba9f req-32db1ec7-2786-411d-a852-6d27855fb930 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:11.315167 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-84729e68-7899-4fdc-b2ac-186cc747ba9f req-32db1ec7-2786-411d-a852-6d27855fb930 service nova] Creating event network-vif-plugged:12d64262-0acf-4b1f-8905-8c5d540e11ec for instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb on hv-cinder-85221 Aug 04 22:24:11.321911 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-84729e68-7899-4fdc-b2ac-186cc747ba9f req-32db1ec7-2786-411d-a852-6d27855fb930 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081623 Aug 04 22:24:11.323105 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 254/500] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:24:11.682896 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-bfdb24c9-ed43-4659-afdc-c7f4b442f8fb tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:11.683562 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-bfdb24c9-ed43-4659-afdc-c7f4b442f8fb tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:11.705991 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bfdb24c9-ed43-4659-afdc-c7f4b442f8fb tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:11.710621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bfdb24c9-ed43-4659-afdc-c7f4b442f8fb tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:11.714316 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bfdb24c9-ed43-4659-afdc-c7f4b442f8fb tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:11.717698 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bfdb24c9-ed43-4659-afdc-c7f4b442f8fb tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:11.719765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bfdb24c9-ed43-4659-afdc-c7f4b442f8fb tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:11.722106 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bfdb24c9-ed43-4659-afdc-c7f4b442f8fb tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:11.786507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1b5bfe88-3f42-40d6-aff8-4aff1adf2b81 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:11.787816 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1b5bfe88-3f42-40d6-aff8-4aff1adf2b81 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:11.796380 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b5bfe88-3f42-40d6-aff8-4aff1adf2b81 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:11.797328 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b5bfe88-3f42-40d6-aff8-4aff1adf2b81 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:11.798008 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b5bfe88-3f42-40d6-aff8-4aff1adf2b81 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:11.798712 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b5bfe88-3f42-40d6-aff8-4aff1adf2b81 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:11.799165 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b5bfe88-3f42-40d6-aff8-4aff1adf2b81 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:11.799583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b5bfe88-3f42-40d6-aff8-4aff1adf2b81 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:11.818915 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=80 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:11.940771 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-bfdb24c9-ed43-4659-afdc-c7f4b442f8fb tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:11.948954 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-bfdb24c9-ed43-4659-afdc-c7f4b442f8fb tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1319 microversion: 2.1 time: 0.271563 Aug 04 22:24:11.962215 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 247/501] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:11 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:11.982470 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1b5bfe88-3f42-40d6-aff8-4aff1adf2b81 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:11.993556 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1b5bfe88-3f42-40d6-aff8-4aff1adf2b81 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1374 microversion: 2.1 time: 0.213909 Aug 04 22:24:11.994295 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 255/502] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:11 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1374 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:24:12.969920 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-bc1ecf2a-756d-499d-94b4-5b91df8f11bd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:12.971844 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-bc1ecf2a-756d-499d-94b4-5b91df8f11bd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:12.980790 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bc1ecf2a-756d-499d-94b4-5b91df8f11bd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:12.982087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bc1ecf2a-756d-499d-94b4-5b91df8f11bd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:12.982733 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bc1ecf2a-756d-499d-94b4-5b91df8f11bd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:12.983731 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bc1ecf2a-756d-499d-94b4-5b91df8f11bd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:12.984441 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bc1ecf2a-756d-499d-94b4-5b91df8f11bd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:12.985008 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bc1ecf2a-756d-499d-94b4-5b91df8f11bd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:13.017170 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a65ebfe9-19fb-41c0-9229-bae384c797d3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:13.017987 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a65ebfe9-19fb-41c0-9229-bae384c797d3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:13.029393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a65ebfe9-19fb-41c0-9229-bae384c797d3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:13.031754 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a65ebfe9-19fb-41c0-9229-bae384c797d3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:13.032649 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a65ebfe9-19fb-41c0-9229-bae384c797d3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:13.034296 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a65ebfe9-19fb-41c0-9229-bae384c797d3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:13.036492 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a65ebfe9-19fb-41c0-9229-bae384c797d3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:13.060284 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a65ebfe9-19fb-41c0-9229-bae384c797d3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:13.354116 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-bc1ecf2a-756d-499d-94b4-5b91df8f11bd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:13.364699 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-bc1ecf2a-756d-499d-94b4-5b91df8f11bd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1319 microversion: 2.1 time: 0.398727 Aug 04 22:24:13.371771 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 248/503] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:12 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:13.428349 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a65ebfe9-19fb-41c0-9229-bae384c797d3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:13.451886 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a65ebfe9-19fb-41c0-9229-bae384c797d3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1374 microversion: 2.1 time: 0.440746 Aug 04 22:24:13.453674 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 256/504] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:13 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1374 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:24:13.548941 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-f296c8fb-479d-4acc-b4d2-c39de38dcae9 req-612e6202-332a-4e4d-9ffc-f87438187bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a8488c-d0a0-415d-915a-b65e92183864", "tag": "aea24818-54c4-4a9e-b2f0-e6b50569da16"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:24:13.566424 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-f296c8fb-479d-4acc-b4d2-c39de38dcae9 req-612e6202-332a-4e4d-9ffc-f87438187bcf service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:13.567418 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-f296c8fb-479d-4acc-b4d2-c39de38dcae9 req-612e6202-332a-4e4d-9ffc-f87438187bcf service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:13.568324 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-f296c8fb-479d-4acc-b4d2-c39de38dcae9 req-612e6202-332a-4e4d-9ffc-f87438187bcf service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:13.600526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-f296c8fb-479d-4acc-b4d2-c39de38dcae9 req-612e6202-332a-4e4d-9ffc-f87438187bcf service nova] Creating event network-changed:aea24818-54c4-4a9e-b2f0-e6b50569da16 for instance a0a8488c-d0a0-415d-915a-b65e92183864 on hv-cinder-85221 Aug 04 22:24:13.622968 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-f296c8fb-479d-4acc-b4d2-c39de38dcae9 req-612e6202-332a-4e4d-9ffc-f87438187bcf service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080779 Aug 04 22:24:13.624645 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 249/505] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:24:14.183072 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-359367681", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "networks": [{"uuid": "a25bf7f0-373b-4d07-9fb0-98e5f145ad8b"}]}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:24:14.259563 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.network.neutron [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] validate_networks() for [('a25bf7f0-373b-4d07-9fb0-98e5f145ad8b', None, None, None, None, None)] {{(pid=129197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:24:14.399359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-074dae45-615a-445c-848d-30afa1ace112 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:14.403212 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-074dae45-615a-445c-848d-30afa1ace112 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:14.417497 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-074dae45-615a-445c-848d-30afa1ace112 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:14.418674 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-074dae45-615a-445c-848d-30afa1ace112 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:14.419420 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-074dae45-615a-445c-848d-30afa1ace112 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:14.420391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-074dae45-615a-445c-848d-30afa1ace112 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:14.421632 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-074dae45-615a-445c-848d-30afa1ace112 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:14.422543 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-074dae45-615a-445c-848d-30afa1ace112 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:14.706233 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-074dae45-615a-445c-848d-30afa1ace112 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:14.717580 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-074dae45-615a-445c-848d-30afa1ace112 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1319 microversion: 2.1 time: 0.328090 Aug 04 22:24:14.723189 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 250/506] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:14 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:24:14.729445 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-89f7820f-afa1-4371-a048-572142094833 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:14.730288 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-89f7820f-afa1-4371-a048-572142094833 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:14.738402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-89f7820f-afa1-4371-a048-572142094833 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:14.741283 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-89f7820f-afa1-4371-a048-572142094833 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:14.741941 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-89f7820f-afa1-4371-a048-572142094833 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:14.743915 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-89f7820f-afa1-4371-a048-572142094833 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:14.744531 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-89f7820f-afa1-4371-a048-572142094833 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:14.745112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-89f7820f-afa1-4371-a048-572142094833 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:15.001002 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-89f7820f-afa1-4371-a048-572142094833 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:15.003336 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=81 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:15.019702 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-89f7820f-afa1-4371-a048-572142094833 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1568 microversion: 2.1 time: 0.295084 Aug 04 22:24:15.020520 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 251/507] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:14 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1568 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:15.029234 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Flavor limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:24:15.030000 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Image limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:24:15.031386 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Flavor pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:24:15.032091 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Image pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:24:15.032720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:24:15.044961 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e37edeea-e1a3-41dc-b50f-01a76e2fa496 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:15.045506 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e37edeea-e1a3-41dc-b50f-01a76e2fa496 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:15.049708 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:15.050438 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:15.051014 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:15.052178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:15.052837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:15.053483 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:15.054775 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e37edeea-e1a3-41dc-b50f-01a76e2fa496 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:15.055267 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e37edeea-e1a3-41dc-b50f-01a76e2fa496 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:15.055705 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e37edeea-e1a3-41dc-b50f-01a76e2fa496 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:15.056401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e37edeea-e1a3-41dc-b50f-01a76e2fa496 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:15.056848 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e37edeea-e1a3-41dc-b50f-01a76e2fa496 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:15.057477 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e37edeea-e1a3-41dc-b50f-01a76e2fa496 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:15.080725 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Getting quotas for project 260c01e60f5e48ac9420c388a958e0ee. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:24:15.086775 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Getting quotas for user 91dd37f744a5476488afe91d97a406a1 and project 260c01e60f5e48ac9420c388a958e0ee. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:24:15.101953 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Going to run 1 instances... {{(pid=129197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:24:15.107378 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:24:15.181891 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-cb1450a7-fbae-4ee4-8b3c-0b078fd0da3d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.001971 Aug 04 22:24:15.189303 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 257/508] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:24:14 2022] POST /compute/v2.1/servers => generated 382 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:24:15.196825 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-93aea57e-92ad-452d-8690-24e63fe5c4fb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:15.198284 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-93aea57e-92ad-452d-8690-24e63fe5c4fb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:15.267197 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e37edeea-e1a3-41dc-b50f-01a76e2fa496 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227444 Aug 04 22:24:15.268256 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 252/509] 10.222.0.109 () {58 vars in 1280 bytes} [Thu Aug 4 22:24:15 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-interface => generated 284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:24:15.571206 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-93aea57e-92ad-452d-8690-24e63fe5c4fb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:15.582930 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-93aea57e-92ad-452d-8690-24e63fe5c4fb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1222 microversion: 2.1 time: 0.391949 Aug 04 22:24:15.618256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 258/510] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:15 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1222 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:15.744609 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b5096229-9670-417d-b12b-36f20c99bf5b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:15.745945 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b5096229-9670-417d-b12b-36f20c99bf5b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:15.758638 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b5096229-9670-417d-b12b-36f20c99bf5b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:15.762773 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b5096229-9670-417d-b12b-36f20c99bf5b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:15.763163 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b5096229-9670-417d-b12b-36f20c99bf5b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:15.764126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b5096229-9670-417d-b12b-36f20c99bf5b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:15.767356 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b5096229-9670-417d-b12b-36f20c99bf5b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:15.768014 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b5096229-9670-417d-b12b-36f20c99bf5b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:16.248174 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b5096229-9670-417d-b12b-36f20c99bf5b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:16.265436 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b5096229-9670-417d-b12b-36f20c99bf5b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1319 microversion: 2.1 time: 0.525464 Aug 04 22:24:16.266399 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 253/511] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:15 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1319 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:16.615808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-336978b2-4ac7-4ff1-8e7e-06e304499a6c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:16.616588 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-336978b2-4ac7-4ff1-8e7e-06e304499a6c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:16.628376 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-336978b2-4ac7-4ff1-8e7e-06e304499a6c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:16.642120 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-336978b2-4ac7-4ff1-8e7e-06e304499a6c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:16.642893 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-336978b2-4ac7-4ff1-8e7e-06e304499a6c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:16.643863 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-336978b2-4ac7-4ff1-8e7e-06e304499a6c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:16.644435 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-336978b2-4ac7-4ff1-8e7e-06e304499a6c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:16.644922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-336978b2-4ac7-4ff1-8e7e-06e304499a6c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:16.793450 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-336978b2-4ac7-4ff1-8e7e-06e304499a6c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:16.808788 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-336978b2-4ac7-4ff1-8e7e-06e304499a6c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1226 microversion: 2.1 time: 0.196879 Aug 04 22:24:16.813963 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 259/512] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:16 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1226 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:17.050284 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-21a73543-1708-466c-bdca-b1914ecd5f69 req-af0fa8ad-277b-4aca-8f54-24e484b60614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cca04a9-f894-43cf-b1d6-009292cdbcbb", "tag": "12d64262-0acf-4b1f-8905-8c5d540e11ec"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:24:17.060323 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-21a73543-1708-466c-bdca-b1914ecd5f69 req-af0fa8ad-277b-4aca-8f54-24e484b60614 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:17.060804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-21a73543-1708-466c-bdca-b1914ecd5f69 req-af0fa8ad-277b-4aca-8f54-24e484b60614 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:17.061228 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-21a73543-1708-466c-bdca-b1914ecd5f69 req-af0fa8ad-277b-4aca-8f54-24e484b60614 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:17.075217 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-21a73543-1708-466c-bdca-b1914ecd5f69 req-af0fa8ad-277b-4aca-8f54-24e484b60614 service nova] Creating event network-changed:12d64262-0acf-4b1f-8905-8c5d540e11ec for instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb on hv-cinder-85221 Aug 04 22:24:17.086202 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-21a73543-1708-466c-bdca-b1914ecd5f69 req-af0fa8ad-277b-4aca-8f54-24e484b60614 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040514 Aug 04 22:24:17.091871 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 254/513] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:24:17.290757 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a4c804ea-f44a-4f52-bf0f-e9c8b713f8cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:17.292609 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a4c804ea-f44a-4f52-bf0f-e9c8b713f8cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:17.307971 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a4c804ea-f44a-4f52-bf0f-e9c8b713f8cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:17.310504 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a4c804ea-f44a-4f52-bf0f-e9c8b713f8cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:17.311675 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a4c804ea-f44a-4f52-bf0f-e9c8b713f8cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:17.314820 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a4c804ea-f44a-4f52-bf0f-e9c8b713f8cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:17.317035 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a4c804ea-f44a-4f52-bf0f-e9c8b713f8cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:17.320934 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a4c804ea-f44a-4f52-bf0f-e9c8b713f8cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:17.559271 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a4c804ea-f44a-4f52-bf0f-e9c8b713f8cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:17.591430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a4c804ea-f44a-4f52-bf0f-e9c8b713f8cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1319 microversion: 2.1 time: 0.302049 Aug 04 22:24:17.616549 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 260/514] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:17 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:17.837282 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e1111c54-7ffb-4ecc-88c1-69ba9b68dace tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:17.838337 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e1111c54-7ffb-4ecc-88c1-69ba9b68dace tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:17.840797 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:17.842045 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=6 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:17.863893 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1111c54-7ffb-4ecc-88c1-69ba9b68dace tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:17.865813 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1111c54-7ffb-4ecc-88c1-69ba9b68dace tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:17.868222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1111c54-7ffb-4ecc-88c1-69ba9b68dace tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:17.869625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1111c54-7ffb-4ecc-88c1-69ba9b68dace tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:17.871102 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1111c54-7ffb-4ecc-88c1-69ba9b68dace tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:17.874703 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1111c54-7ffb-4ecc-88c1-69ba9b68dace tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:18.014208 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e1111c54-7ffb-4ecc-88c1-69ba9b68dace tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:18.033270 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e1111c54-7ffb-4ecc-88c1-69ba9b68dace tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1226 microversion: 2.1 time: 0.200346 Aug 04 22:24:18.043114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 255/515] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:17 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1226 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:18.628144 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7baff69d-e7c4-473e-831b-1a0fb99236d1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:18.628832 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7baff69d-e7c4-473e-831b-1a0fb99236d1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:18.650847 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7baff69d-e7c4-473e-831b-1a0fb99236d1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:18.651365 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7baff69d-e7c4-473e-831b-1a0fb99236d1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:18.651956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7baff69d-e7c4-473e-831b-1a0fb99236d1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:18.652993 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7baff69d-e7c4-473e-831b-1a0fb99236d1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:18.653542 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7baff69d-e7c4-473e-831b-1a0fb99236d1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:18.654147 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7baff69d-e7c4-473e-831b-1a0fb99236d1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:19.082764 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7baff69d-e7c4-473e-831b-1a0fb99236d1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:19.086293 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a8d5660b-66c9-433c-a82b-bac9b324d633 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:19.091457 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a8d5660b-66c9-433c-a82b-bac9b324d633 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:19.112862 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7baff69d-e7c4-473e-831b-1a0fb99236d1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1319 microversion: 2.1 time: 0.499985 Aug 04 22:24:19.116578 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 261/516] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:18 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:19.122821 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a8d5660b-66c9-433c-a82b-bac9b324d633 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:19.123528 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a8d5660b-66c9-433c-a82b-bac9b324d633 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:19.124954 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a8d5660b-66c9-433c-a82b-bac9b324d633 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:19.125870 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a8d5660b-66c9-433c-a82b-bac9b324d633 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:19.126460 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a8d5660b-66c9-433c-a82b-bac9b324d633 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:19.127033 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a8d5660b-66c9-433c-a82b-bac9b324d633 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:19.408127 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a8d5660b-66c9-433c-a82b-bac9b324d633 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:19.421989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a8d5660b-66c9-433c-a82b-bac9b324d633 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1218 microversion: 2.1 time: 0.351127 Aug 04 22:24:19.423231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 256/517] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:19 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1218 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:20.136417 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3961c8ef-6a58-4401-bf34-ba63b6686293 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:20.137876 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3961c8ef-6a58-4401-bf34-ba63b6686293 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:20.152825 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3961c8ef-6a58-4401-bf34-ba63b6686293 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:20.172583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3961c8ef-6a58-4401-bf34-ba63b6686293 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:20.173684 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3961c8ef-6a58-4401-bf34-ba63b6686293 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:20.174613 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3961c8ef-6a58-4401-bf34-ba63b6686293 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:20.177143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3961c8ef-6a58-4401-bf34-ba63b6686293 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:20.180192 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3961c8ef-6a58-4401-bf34-ba63b6686293 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:20.443591 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b3477524-0651-4529-b250-4d38af16d4a8 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:20.445148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b3477524-0651-4529-b250-4d38af16d4a8 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:20.457158 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3477524-0651-4529-b250-4d38af16d4a8 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:20.461154 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3477524-0651-4529-b250-4d38af16d4a8 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:20.462859 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3477524-0651-4529-b250-4d38af16d4a8 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:20.466134 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3477524-0651-4529-b250-4d38af16d4a8 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:20.466756 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3477524-0651-4529-b250-4d38af16d4a8 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:20.469331 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3477524-0651-4529-b250-4d38af16d4a8 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:20.611541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b3477524-0651-4529-b250-4d38af16d4a8 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:20.620746 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b3477524-0651-4529-b250-4d38af16d4a8 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1280 microversion: 2.1 time: 0.181003 Aug 04 22:24:20.621787 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 257/518] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:20 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1280 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:24:20.727635 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3961c8ef-6a58-4401-bf34-ba63b6686293 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:20.736297 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3961c8ef-6a58-4401-bf34-ba63b6686293 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1319 microversion: 2.1 time: 0.605025 Aug 04 22:24:20.750394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 262/519] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:20 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1319 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:21.644571 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4bce10c8-876f-4826-8fc1-cd9c9ba1c687 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:21.645178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4bce10c8-876f-4826-8fc1-cd9c9ba1c687 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:21.659655 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4bce10c8-876f-4826-8fc1-cd9c9ba1c687 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:21.660145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4bce10c8-876f-4826-8fc1-cd9c9ba1c687 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:21.660574 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4bce10c8-876f-4826-8fc1-cd9c9ba1c687 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:21.661272 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4bce10c8-876f-4826-8fc1-cd9c9ba1c687 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:21.661947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4bce10c8-876f-4826-8fc1-cd9c9ba1c687 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:21.662157 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4bce10c8-876f-4826-8fc1-cd9c9ba1c687 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:21.758726 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-508c85dc-2755-4826-9fd1-9deb24013bc3 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:21.759786 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-508c85dc-2755-4826-9fd1-9deb24013bc3 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:21.765084 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:21.779131 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-508c85dc-2755-4826-9fd1-9deb24013bc3 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:21.782125 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-508c85dc-2755-4826-9fd1-9deb24013bc3 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:21.782949 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-508c85dc-2755-4826-9fd1-9deb24013bc3 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:21.783883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-508c85dc-2755-4826-9fd1-9deb24013bc3 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:21.784351 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-508c85dc-2755-4826-9fd1-9deb24013bc3 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:21.785567 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-508c85dc-2755-4826-9fd1-9deb24013bc3 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:21.967363 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4bce10c8-876f-4826-8fc1-cd9c9ba1c687 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:21.983427 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4bce10c8-876f-4826-8fc1-cd9c9ba1c687 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.338948 Aug 04 22:24:21.986676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 258/520] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:21 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:22.111572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-508c85dc-2755-4826-9fd1-9deb24013bc3 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:22.119701 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-508c85dc-2755-4826-9fd1-9deb24013bc3 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1319 microversion: 2.1 time: 0.366069 Aug 04 22:24:22.123142 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 263/521] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:21 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:22.378353 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-3ca83927-e949-4b90-8c2b-d6f57a016d65 req-63170cec-2df8-4183-8512-2ef1296350f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e3daf69-e689-453d-81d4-9eba29e8f352", "tag": "2d51d6ec-ea63-4dc6-983d-b1edffe34560"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:24:22.401589 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-3ca83927-e949-4b90-8c2b-d6f57a016d65 req-63170cec-2df8-4183-8512-2ef1296350f2 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:22.403438 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-3ca83927-e949-4b90-8c2b-d6f57a016d65 req-63170cec-2df8-4183-8512-2ef1296350f2 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:22.406324 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-3ca83927-e949-4b90-8c2b-d6f57a016d65 req-63170cec-2df8-4183-8512-2ef1296350f2 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:22.435394 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-3ca83927-e949-4b90-8c2b-d6f57a016d65 req-63170cec-2df8-4183-8512-2ef1296350f2 service nova] Creating event network-changed:2d51d6ec-ea63-4dc6-983d-b1edffe34560 for instance 9e3daf69-e689-453d-81d4-9eba29e8f352 on hv-cinder-85221 Aug 04 22:24:22.454115 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-3ca83927-e949-4b90-8c2b-d6f57a016d65 req-63170cec-2df8-4183-8512-2ef1296350f2 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079774 Aug 04 22:24:22.457070 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 259/522] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:24:23.010809 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1c9a9d76-d8d7-4b90-8e0a-b6f242fb6767 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:23.011519 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1c9a9d76-d8d7-4b90-8e0a-b6f242fb6767 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:23.022210 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1c9a9d76-d8d7-4b90-8e0a-b6f242fb6767 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:23.023708 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1c9a9d76-d8d7-4b90-8e0a-b6f242fb6767 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:23.026459 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1c9a9d76-d8d7-4b90-8e0a-b6f242fb6767 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:23.027242 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1c9a9d76-d8d7-4b90-8e0a-b6f242fb6767 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:23.028308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1c9a9d76-d8d7-4b90-8e0a-b6f242fb6767 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:23.028939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1c9a9d76-d8d7-4b90-8e0a-b6f242fb6767 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:23.147378 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f4693262-1d2f-4c06-878e-d9d76fc853ed tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:23.148226 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f4693262-1d2f-4c06-878e-d9d76fc853ed tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:23.166738 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f4693262-1d2f-4c06-878e-d9d76fc853ed tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:23.167531 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f4693262-1d2f-4c06-878e-d9d76fc853ed tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:23.169288 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f4693262-1d2f-4c06-878e-d9d76fc853ed tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:23.172415 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f4693262-1d2f-4c06-878e-d9d76fc853ed tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:23.174316 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f4693262-1d2f-4c06-878e-d9d76fc853ed tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:23.174834 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f4693262-1d2f-4c06-878e-d9d76fc853ed tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:23.390238 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1c9a9d76-d8d7-4b90-8e0a-b6f242fb6767 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:23.402521 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1c9a9d76-d8d7-4b90-8e0a-b6f242fb6767 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.395007 Aug 04 22:24:23.406244 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 264/523] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:23 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:23.457259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f4693262-1d2f-4c06-878e-d9d76fc853ed tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:23.468214 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f4693262-1d2f-4c06-878e-d9d76fc853ed tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1319 microversion: 2.1 time: 0.325049 Aug 04 22:24:23.469435 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 260/524] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:23 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:23.544148 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-c3d0fd19-3035-4dd7-836d-25b7f8c45b33 req-8e3806cb-5101-44ef-a416-79d2a5799f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a8488c-d0a0-415d-915a-b65e92183864", "name": "network-vif-plugged", "status": "completed", "tag": "aea24818-54c4-4a9e-b2f0-e6b50569da16"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:24:23.565836 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c3d0fd19-3035-4dd7-836d-25b7f8c45b33 req-8e3806cb-5101-44ef-a416-79d2a5799f02 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:23.566593 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c3d0fd19-3035-4dd7-836d-25b7f8c45b33 req-8e3806cb-5101-44ef-a416-79d2a5799f02 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:23.568234 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c3d0fd19-3035-4dd7-836d-25b7f8c45b33 req-8e3806cb-5101-44ef-a416-79d2a5799f02 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:23.606261 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-c3d0fd19-3035-4dd7-836d-25b7f8c45b33 req-8e3806cb-5101-44ef-a416-79d2a5799f02 service nova] Creating event network-vif-plugged:aea24818-54c4-4a9e-b2f0-e6b50569da16 for instance a0a8488c-d0a0-415d-915a-b65e92183864 on hv-cinder-85221 Aug 04 22:24:23.621105 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-c3d0fd19-3035-4dd7-836d-25b7f8c45b33 req-8e3806cb-5101-44ef-a416-79d2a5799f02 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080461 Aug 04 22:24:23.622222 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 265/525] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:24:24.430325 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-38af4cfa-dd4b-485d-a3da-1677f79c5126 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:24.431045 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-38af4cfa-dd4b-485d-a3da-1677f79c5126 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:24.441134 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-38af4cfa-dd4b-485d-a3da-1677f79c5126 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:24.442719 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-38af4cfa-dd4b-485d-a3da-1677f79c5126 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:24.443225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-38af4cfa-dd4b-485d-a3da-1677f79c5126 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:24.444968 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-38af4cfa-dd4b-485d-a3da-1677f79c5126 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:24.448261 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-38af4cfa-dd4b-485d-a3da-1677f79c5126 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:24.450032 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-38af4cfa-dd4b-485d-a3da-1677f79c5126 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:24.489040 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6c9c53f8-83e3-4263-982a-95af92d3119e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:24.499152 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6c9c53f8-83e3-4263-982a-95af92d3119e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:24.512317 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6c9c53f8-83e3-4263-982a-95af92d3119e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:24.513184 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6c9c53f8-83e3-4263-982a-95af92d3119e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:24.516411 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6c9c53f8-83e3-4263-982a-95af92d3119e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:24.517973 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6c9c53f8-83e3-4263-982a-95af92d3119e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:24.518727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6c9c53f8-83e3-4263-982a-95af92d3119e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:24.523261 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6c9c53f8-83e3-4263-982a-95af92d3119e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:24.749476 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-38af4cfa-dd4b-485d-a3da-1677f79c5126 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:24.751734 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6c9c53f8-83e3-4263-982a-95af92d3119e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:24.759578 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-38af4cfa-dd4b-485d-a3da-1677f79c5126 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.334534 Aug 04 22:24:24.760191 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6c9c53f8-83e3-4263-982a-95af92d3119e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1319 microversion: 2.1 time: 0.275455 Aug 04 22:24:24.769491 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 266/526] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:24 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:24.770182 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 261/527] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:24 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:25.781618 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a12fd189-449f-4e02-b4c3-79ecda5f7545 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:25.782240 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a12fd189-449f-4e02-b4c3-79ecda5f7545 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:25.788608 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6f25b58d-5d0b-4ac3-b547-c9266396ec1e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:25.789222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6f25b58d-5d0b-4ac3-b547-c9266396ec1e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:25.795925 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:25.796089 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6f25b58d-5d0b-4ac3-b547-c9266396ec1e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:25.797851 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=10 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:25.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6f25b58d-5d0b-4ac3-b547-c9266396ec1e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:25.798889 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6f25b58d-5d0b-4ac3-b547-c9266396ec1e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:25.799678 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a12fd189-449f-4e02-b4c3-79ecda5f7545 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:25.800196 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a12fd189-449f-4e02-b4c3-79ecda5f7545 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:25.800445 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6f25b58d-5d0b-4ac3-b547-c9266396ec1e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:25.800665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a12fd189-449f-4e02-b4c3-79ecda5f7545 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:25.801220 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6f25b58d-5d0b-4ac3-b547-c9266396ec1e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:25.801483 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a12fd189-449f-4e02-b4c3-79ecda5f7545 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:25.801967 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a12fd189-449f-4e02-b4c3-79ecda5f7545 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:25.802231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6f25b58d-5d0b-4ac3-b547-c9266396ec1e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:25.802394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a12fd189-449f-4e02-b4c3-79ecda5f7545 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:25.949981 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6f25b58d-5d0b-4ac3-b547-c9266396ec1e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:25.951987 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a12fd189-449f-4e02-b4c3-79ecda5f7545 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:25.961961 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a12fd189-449f-4e02-b4c3-79ecda5f7545 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.184455 Aug 04 22:24:25.962528 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 267/528] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:25 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:25.971962 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6f25b58d-5d0b-4ac3-b547-c9266396ec1e tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1319 microversion: 2.1 time: 0.186944 Aug 04 22:24:25.973114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 262/529] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:25 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:26.984323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0505f176-1142-4d42-bc52-12b91f61cb2a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:26.985501 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0505f176-1142-4d42-bc52-12b91f61cb2a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:26.997503 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7d06ca4e-f1fd-44e9-b514-cd3bed5880cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:26.998120 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7d06ca4e-f1fd-44e9-b514-cd3bed5880cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:27.010740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0505f176-1142-4d42-bc52-12b91f61cb2a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:27.011257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0505f176-1142-4d42-bc52-12b91f61cb2a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:27.011703 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0505f176-1142-4d42-bc52-12b91f61cb2a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:27.012431 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0505f176-1142-4d42-bc52-12b91f61cb2a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:27.017454 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d06ca4e-f1fd-44e9-b514-cd3bed5880cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:27.018004 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d06ca4e-f1fd-44e9-b514-cd3bed5880cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:27.018452 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d06ca4e-f1fd-44e9-b514-cd3bed5880cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:27.019173 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d06ca4e-f1fd-44e9-b514-cd3bed5880cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:27.019630 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d06ca4e-f1fd-44e9-b514-cd3bed5880cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:27.021102 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0505f176-1142-4d42-bc52-12b91f61cb2a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:27.022980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0505f176-1142-4d42-bc52-12b91f61cb2a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:27.028135 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d06ca4e-f1fd-44e9-b514-cd3bed5880cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:27.205751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7d06ca4e-f1fd-44e9-b514-cd3bed5880cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:27.213756 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7d06ca4e-f1fd-44e9-b514-cd3bed5880cd tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1319 microversion: 2.1 time: 0.219820 Aug 04 22:24:27.215053 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 263/530] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:26 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:24:27.222721 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0505f176-1142-4d42-bc52-12b91f61cb2a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:27.231375 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0505f176-1142-4d42-bc52-12b91f61cb2a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.251321 Aug 04 22:24:27.231938 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 268/531] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:26 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:28.236504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-465a77f1-5368-4adc-8529-e1a3a822026b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:28.237100 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-465a77f1-5368-4adc-8529-e1a3a822026b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:28.253426 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-8c3b2ae1-6a02-4809-ac3a-96d0f4fd15c0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:28.254659 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-8c3b2ae1-6a02-4809-ac3a-96d0f4fd15c0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:28.266672 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c3b2ae1-6a02-4809-ac3a-96d0f4fd15c0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:28.267534 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c3b2ae1-6a02-4809-ac3a-96d0f4fd15c0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:28.268377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c3b2ae1-6a02-4809-ac3a-96d0f4fd15c0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:28.269150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-465a77f1-5368-4adc-8529-e1a3a822026b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:28.269578 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c3b2ae1-6a02-4809-ac3a-96d0f4fd15c0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:28.269700 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-465a77f1-5368-4adc-8529-e1a3a822026b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:28.270390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c3b2ae1-6a02-4809-ac3a-96d0f4fd15c0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:28.270510 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-465a77f1-5368-4adc-8529-e1a3a822026b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:28.271745 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-465a77f1-5368-4adc-8529-e1a3a822026b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:28.271936 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c3b2ae1-6a02-4809-ac3a-96d0f4fd15c0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:28.273036 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-465a77f1-5368-4adc-8529-e1a3a822026b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:28.273987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-465a77f1-5368-4adc-8529-e1a3a822026b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:28.581449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-465a77f1-5368-4adc-8529-e1a3a822026b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:28.589584 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-465a77f1-5368-4adc-8529-e1a3a822026b tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1319 microversion: 2.1 time: 0.357663 Aug 04 22:24:28.590153 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 264/532] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:28 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:28.605168 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8c3b2ae1-6a02-4809-ac3a-96d0f4fd15c0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:28.624014 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-8c3b2ae1-6a02-4809-ac3a-96d0f4fd15c0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.368977 Aug 04 22:24:28.624014 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 269/533] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:28 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:29.610679 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-67336cd7-f63c-43bc-8b2d-9244e9fd9712 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:29.611297 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-67336cd7-f63c-43bc-8b2d-9244e9fd9712 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:29.613952 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:29.621622 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-67336cd7-f63c-43bc-8b2d-9244e9fd9712 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:29.622409 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-67336cd7-f63c-43bc-8b2d-9244e9fd9712 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:29.622916 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-67336cd7-f63c-43bc-8b2d-9244e9fd9712 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:29.624271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-67336cd7-f63c-43bc-8b2d-9244e9fd9712 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:29.624923 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-67336cd7-f63c-43bc-8b2d-9244e9fd9712 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:29.625599 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-67336cd7-f63c-43bc-8b2d-9244e9fd9712 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:29.643098 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7c88f104-56f1-441c-ad0e-d1cd77ad2a3e tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:29.643710 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7c88f104-56f1-441c-ad0e-d1cd77ad2a3e tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:29.659545 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7c88f104-56f1-441c-ad0e-d1cd77ad2a3e tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:29.660360 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7c88f104-56f1-441c-ad0e-d1cd77ad2a3e tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:29.660972 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7c88f104-56f1-441c-ad0e-d1cd77ad2a3e tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:29.662141 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7c88f104-56f1-441c-ad0e-d1cd77ad2a3e tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:29.662904 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7c88f104-56f1-441c-ad0e-d1cd77ad2a3e tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:29.663580 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7c88f104-56f1-441c-ad0e-d1cd77ad2a3e tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:29.879852 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-67336cd7-f63c-43bc-8b2d-9244e9fd9712 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:29.888073 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-67336cd7-f63c-43bc-8b2d-9244e9fd9712 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1468 microversion: 2.1 time: 0.281611 Aug 04 22:24:29.888777 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 265/534] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:29 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1468 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:29.935221 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7c88f104-56f1-441c-ad0e-d1cd77ad2a3e tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:29.943708 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7c88f104-56f1-441c-ad0e-d1cd77ad2a3e tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.305167 Aug 04 22:24:29.944353 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 270/535] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:29 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:24:29.959402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-994d8f49-3485-40cd-b391-825e044e7b88 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:29.960091 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-994d8f49-3485-40cd-b391-825e044e7b88 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:29.965894 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-994d8f49-3485-40cd-b391-825e044e7b88 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:29.966631 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-994d8f49-3485-40cd-b391-825e044e7b88 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:29.967159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-994d8f49-3485-40cd-b391-825e044e7b88 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:29.967864 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-994d8f49-3485-40cd-b391-825e044e7b88 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:29.968438 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-994d8f49-3485-40cd-b391-825e044e7b88 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:29.969032 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-994d8f49-3485-40cd-b391-825e044e7b88 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:29.994512 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-994d8f49-3485-40cd-b391-825e044e7b88 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Going to try to terminate instance {{(pid=129196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:24:30.112297 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-994d8f49-3485-40cd-b391-825e044e7b88 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "DELETE /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 204 len: 0 microversion: 2.1 time: 0.156432 Aug 04 22:24:30.113282 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 266/536] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:24:29 2022] DELETE /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:24:30.122375 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2adb7439-9fb6-4406-ac6b-44b3e441e7a7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:30.123365 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2adb7439-9fb6-4406-ac6b-44b3e441e7a7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:30.132707 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2adb7439-9fb6-4406-ac6b-44b3e441e7a7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:30.133636 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2adb7439-9fb6-4406-ac6b-44b3e441e7a7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:30.134306 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2adb7439-9fb6-4406-ac6b-44b3e441e7a7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:30.135441 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2adb7439-9fb6-4406-ac6b-44b3e441e7a7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:30.136340 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2adb7439-9fb6-4406-ac6b-44b3e441e7a7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:30.136933 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2adb7439-9fb6-4406-ac6b-44b3e441e7a7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:30.321226 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2adb7439-9fb6-4406-ac6b-44b3e441e7a7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:30.329939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2adb7439-9fb6-4406-ac6b-44b3e441e7a7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1474 microversion: 2.1 time: 0.212427 Aug 04 22:24:30.330502 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 271/537] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:30 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1474 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:24:30.966350 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b59df0a4-1e89-4b68-8250-79eabcff4df6 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:30.967876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b59df0a4-1e89-4b68-8250-79eabcff4df6 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:30.976464 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b59df0a4-1e89-4b68-8250-79eabcff4df6 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:30.977573 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b59df0a4-1e89-4b68-8250-79eabcff4df6 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:30.978295 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b59df0a4-1e89-4b68-8250-79eabcff4df6 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:30.979334 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b59df0a4-1e89-4b68-8250-79eabcff4df6 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:30.980078 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b59df0a4-1e89-4b68-8250-79eabcff4df6 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:30.980798 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b59df0a4-1e89-4b68-8250-79eabcff4df6 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:31.137867 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b59df0a4-1e89-4b68-8250-79eabcff4df6 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:31.145688 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b59df0a4-1e89-4b68-8250-79eabcff4df6 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.184335 Aug 04 22:24:31.146508 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 267/538] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:30 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:31.351124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2fd891d0-1e33-44e6-bb79-599fcb9dd2f9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:31.351743 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2fd891d0-1e33-44e6-bb79-599fcb9dd2f9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:31.357645 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2fd891d0-1e33-44e6-bb79-599fcb9dd2f9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:31.358167 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2fd891d0-1e33-44e6-bb79-599fcb9dd2f9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:31.359532 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2fd891d0-1e33-44e6-bb79-599fcb9dd2f9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:31.360385 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2fd891d0-1e33-44e6-bb79-599fcb9dd2f9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:31.360874 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2fd891d0-1e33-44e6-bb79-599fcb9dd2f9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:31.361306 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2fd891d0-1e33-44e6-bb79-599fcb9dd2f9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:31.493665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2fd891d0-1e33-44e6-bb79-599fcb9dd2f9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:31.501941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2fd891d0-1e33-44e6-bb79-599fcb9dd2f9 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1474 microversion: 2.1 time: 0.154526 Aug 04 22:24:31.502765 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 272/539] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:31 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1474 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:31.617869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-3d2fd376-bd77-4b29-b200-148392922201 req-a9342d78-409f-473c-8bff-c06cd1611d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3daf69-e689-453d-81d4-9eba29e8f352", "name": "network-vif-plugged", "status": "completed", "tag": "2d51d6ec-ea63-4dc6-983d-b1edffe34560"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:24:31.627932 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-3d2fd376-bd77-4b29-b200-148392922201 req-a9342d78-409f-473c-8bff-c06cd1611d52 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:31.628382 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-3d2fd376-bd77-4b29-b200-148392922201 req-a9342d78-409f-473c-8bff-c06cd1611d52 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:31.628866 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-3d2fd376-bd77-4b29-b200-148392922201 req-a9342d78-409f-473c-8bff-c06cd1611d52 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:31.639867 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-3d2fd376-bd77-4b29-b200-148392922201 req-a9342d78-409f-473c-8bff-c06cd1611d52 service nova] Creating event network-vif-plugged:2d51d6ec-ea63-4dc6-983d-b1edffe34560 for instance 9e3daf69-e689-453d-81d4-9eba29e8f352 on hv-cinder-85221 Aug 04 22:24:31.644998 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-3d2fd376-bd77-4b29-b200-148392922201 req-a9342d78-409f-473c-8bff-c06cd1611d52 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031122 Aug 04 22:24:31.645824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 268/540] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:24:32.167089 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7985ee68-4944-4fe6-88c3-ab6706d37afb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:32.167688 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7985ee68-4944-4fe6-88c3-ab6706d37afb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:32.174764 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7985ee68-4944-4fe6-88c3-ab6706d37afb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:32.175258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7985ee68-4944-4fe6-88c3-ab6706d37afb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:32.175706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7985ee68-4944-4fe6-88c3-ab6706d37afb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:32.176473 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7985ee68-4944-4fe6-88c3-ab6706d37afb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:32.176861 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7985ee68-4944-4fe6-88c3-ab6706d37afb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:32.177571 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7985ee68-4944-4fe6-88c3-ab6706d37afb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:32.312255 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7985ee68-4944-4fe6-88c3-ab6706d37afb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:32.319653 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7985ee68-4944-4fe6-88c3-ab6706d37afb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.156604 Aug 04 22:24:32.320219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 273/541] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:32 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:32.525103 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5a419614-e1a8-4fc7-8efa-9664be5dde0d tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:32.525742 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5a419614-e1a8-4fc7-8efa-9664be5dde0d tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:32.532506 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5a419614-e1a8-4fc7-8efa-9664be5dde0d tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:32.533055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5a419614-e1a8-4fc7-8efa-9664be5dde0d tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:32.533628 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5a419614-e1a8-4fc7-8efa-9664be5dde0d tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:32.534411 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5a419614-e1a8-4fc7-8efa-9664be5dde0d tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:32.534985 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5a419614-e1a8-4fc7-8efa-9664be5dde0d tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:32.535514 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5a419614-e1a8-4fc7-8efa-9664be5dde0d tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:32.539758 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:32.666710 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5a419614-e1a8-4fc7-8efa-9664be5dde0d tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:32.674171 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5a419614-e1a8-4fc7-8efa-9664be5dde0d tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1474 microversion: 2.1 time: 0.153769 Aug 04 22:24:32.674743 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 269/542] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:32 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1474 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:33.341139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-38e85d50-3125-4bdf-9ad0-199c01919869 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:33.341781 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-38e85d50-3125-4bdf-9ad0-199c01919869 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:33.347636 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-38e85d50-3125-4bdf-9ad0-199c01919869 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:33.348111 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-38e85d50-3125-4bdf-9ad0-199c01919869 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:33.348534 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-38e85d50-3125-4bdf-9ad0-199c01919869 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:33.349215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-38e85d50-3125-4bdf-9ad0-199c01919869 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:33.349697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-38e85d50-3125-4bdf-9ad0-199c01919869 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:33.350117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-38e85d50-3125-4bdf-9ad0-199c01919869 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:33.353904 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=100 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:33.486449 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-38e85d50-3125-4bdf-9ad0-199c01919869 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:33.494079 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-38e85d50-3125-4bdf-9ad0-199c01919869 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.156790 Aug 04 22:24:33.494638 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 274/543] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:33 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:33.695357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4c8ba674-b250-40a3-880c-bef91f5391e2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:33.695883 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4c8ba674-b250-40a3-880c-bef91f5391e2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:33.702986 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c8ba674-b250-40a3-880c-bef91f5391e2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:33.703459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c8ba674-b250-40a3-880c-bef91f5391e2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:33.703895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c8ba674-b250-40a3-880c-bef91f5391e2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:33.704589 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c8ba674-b250-40a3-880c-bef91f5391e2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:33.705045 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c8ba674-b250-40a3-880c-bef91f5391e2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:33.705493 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c8ba674-b250-40a3-880c-bef91f5391e2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:33.836529 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4c8ba674-b250-40a3-880c-bef91f5391e2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:33.844447 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4c8ba674-b250-40a3-880c-bef91f5391e2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1474 microversion: 2.1 time: 0.153030 Aug 04 22:24:33.845011 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 270/544] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:33 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1474 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:34.515266 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-8959631e-b3e5-4a3b-b25a-38e3b6385d7b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:34.515820 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-8959631e-b3e5-4a3b-b25a-38e3b6385d7b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:34.521625 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8959631e-b3e5-4a3b-b25a-38e3b6385d7b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:34.522103 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8959631e-b3e5-4a3b-b25a-38e3b6385d7b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:34.522530 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8959631e-b3e5-4a3b-b25a-38e3b6385d7b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:34.523210 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8959631e-b3e5-4a3b-b25a-38e3b6385d7b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:34.523658 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8959631e-b3e5-4a3b-b25a-38e3b6385d7b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:34.524074 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8959631e-b3e5-4a3b-b25a-38e3b6385d7b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:34.651586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8959631e-b3e5-4a3b-b25a-38e3b6385d7b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:34.659653 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-8959631e-b3e5-4a3b-b25a-38e3b6385d7b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.148889 Aug 04 22:24:34.660212 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 275/545] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:34 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:34.865539 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-84d4640e-c9d9-40c9-a0d8-a411606e83bf tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:34.866155 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-84d4640e-c9d9-40c9-a0d8-a411606e83bf tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:34.872600 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84d4640e-c9d9-40c9-a0d8-a411606e83bf tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:34.873085 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84d4640e-c9d9-40c9-a0d8-a411606e83bf tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:34.873552 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84d4640e-c9d9-40c9-a0d8-a411606e83bf tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:34.874743 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84d4640e-c9d9-40c9-a0d8-a411606e83bf tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:34.875249 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84d4640e-c9d9-40c9-a0d8-a411606e83bf tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:34.875657 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84d4640e-c9d9-40c9-a0d8-a411606e83bf tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:35.006331 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-84d4640e-c9d9-40c9-a0d8-a411606e83bf tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:35.013853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-84d4640e-c9d9-40c9-a0d8-a411606e83bf tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1474 microversion: 2.1 time: 0.152464 Aug 04 22:24:35.014415 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 271/546] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:34 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1474 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:35.680500 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7e993c56-f3d1-4ea5-85e6-f0d99b9d5523 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:35.681051 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7e993c56-f3d1-4ea5-85e6-f0d99b9d5523 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:35.687084 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e993c56-f3d1-4ea5-85e6-f0d99b9d5523 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:35.687584 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e993c56-f3d1-4ea5-85e6-f0d99b9d5523 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:35.688015 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e993c56-f3d1-4ea5-85e6-f0d99b9d5523 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:35.688693 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e993c56-f3d1-4ea5-85e6-f0d99b9d5523 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:35.689154 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e993c56-f3d1-4ea5-85e6-f0d99b9d5523 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:35.689610 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e993c56-f3d1-4ea5-85e6-f0d99b9d5523 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:35.820532 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7e993c56-f3d1-4ea5-85e6-f0d99b9d5523 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:35.827962 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7e993c56-f3d1-4ea5-85e6-f0d99b9d5523 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.151369 Aug 04 22:24:35.828539 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 276/547] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:35 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:36.036033 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-2b0183e2-949a-4b11-a3e7-4d49c5292ce2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:36.036557 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-2b0183e2-949a-4b11-a3e7-4d49c5292ce2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:36.043360 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2b0183e2-949a-4b11-a3e7-4d49c5292ce2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:36.043841 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2b0183e2-949a-4b11-a3e7-4d49c5292ce2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:36.044272 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2b0183e2-949a-4b11-a3e7-4d49c5292ce2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:36.044953 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2b0183e2-949a-4b11-a3e7-4d49c5292ce2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:36.045398 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2b0183e2-949a-4b11-a3e7-4d49c5292ce2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:36.046222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2b0183e2-949a-4b11-a3e7-4d49c5292ce2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:36.177225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2b0183e2-949a-4b11-a3e7-4d49c5292ce2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:36.184621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-2b0183e2-949a-4b11-a3e7-4d49c5292ce2 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1474 microversion: 2.1 time: 0.152498 Aug 04 22:24:36.185178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 272/548] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:36 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1474 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:36.848148 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-62053e8a-34eb-4d86-b072-9b8fff456012 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:36.849031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-62053e8a-34eb-4d86-b072-9b8fff456012 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:36.854989 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62053e8a-34eb-4d86-b072-9b8fff456012 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:36.855477 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62053e8a-34eb-4d86-b072-9b8fff456012 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:36.855919 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62053e8a-34eb-4d86-b072-9b8fff456012 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:36.856628 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62053e8a-34eb-4d86-b072-9b8fff456012 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:36.857072 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62053e8a-34eb-4d86-b072-9b8fff456012 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:36.857538 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62053e8a-34eb-4d86-b072-9b8fff456012 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:36.985113 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-62053e8a-34eb-4d86-b072-9b8fff456012 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:36.992714 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-62053e8a-34eb-4d86-b072-9b8fff456012 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.148474 Aug 04 22:24:36.993287 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 277/549] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:36 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:37.205201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-34c085ab-4abb-4cb9-b5bf-79602af10ffc tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:37.205833 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-34c085ab-4abb-4cb9-b5bf-79602af10ffc tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:37.212147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-34c085ab-4abb-4cb9-b5bf-79602af10ffc tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:37.212621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-34c085ab-4abb-4cb9-b5bf-79602af10ffc tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:37.213050 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-34c085ab-4abb-4cb9-b5bf-79602af10ffc tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:37.213761 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-34c085ab-4abb-4cb9-b5bf-79602af10ffc tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:37.214213 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-34c085ab-4abb-4cb9-b5bf-79602af10ffc tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:37.214629 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-34c085ab-4abb-4cb9-b5bf-79602af10ffc tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:37.343865 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-34c085ab-4abb-4cb9-b5bf-79602af10ffc tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:37.351347 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-34c085ab-4abb-4cb9-b5bf-79602af10ffc tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1474 microversion: 2.1 time: 0.149959 Aug 04 22:24:37.351906 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 273/550] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:37 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1474 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:37.670071 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-d947a521-5b5c-487e-9fd2-874317073dac req-6de8f677-0795-4d50-ab81-f43ea11e3d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a8488c-d0a0-415d-915a-b65e92183864", "name": "network-vif-unplugged", "status": "completed", "tag": "aea24818-54c4-4a9e-b2f0-e6b50569da16"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:24:37.681790 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-d947a521-5b5c-487e-9fd2-874317073dac req-6de8f677-0795-4d50-ab81-f43ea11e3d35 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:37.682701 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-d947a521-5b5c-487e-9fd2-874317073dac req-6de8f677-0795-4d50-ab81-f43ea11e3d35 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:37.683159 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-d947a521-5b5c-487e-9fd2-874317073dac req-6de8f677-0795-4d50-ab81-f43ea11e3d35 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:37.695653 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-d947a521-5b5c-487e-9fd2-874317073dac req-6de8f677-0795-4d50-ab81-f43ea11e3d35 service nova] Creating event network-vif-unplugged:aea24818-54c4-4a9e-b2f0-e6b50569da16 for instance a0a8488c-d0a0-415d-915a-b65e92183864 on hv-cinder-85221 Aug 04 22:24:37.700668 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-d947a521-5b5c-487e-9fd2-874317073dac req-6de8f677-0795-4d50-ab81-f43ea11e3d35 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035437 Aug 04 22:24:37.701367 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 278/551] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:24:38.014116 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-25b3b780-1f20-4e35-81c9-78fd1a86f5ca tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:38.014646 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-25b3b780-1f20-4e35-81c9-78fd1a86f5ca tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:38.021646 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25b3b780-1f20-4e35-81c9-78fd1a86f5ca tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:38.022128 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25b3b780-1f20-4e35-81c9-78fd1a86f5ca tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:38.022561 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25b3b780-1f20-4e35-81c9-78fd1a86f5ca tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:38.023245 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25b3b780-1f20-4e35-81c9-78fd1a86f5ca tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:38.023694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25b3b780-1f20-4e35-81c9-78fd1a86f5ca tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:38.024114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25b3b780-1f20-4e35-81c9-78fd1a86f5ca tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:38.155755 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-25b3b780-1f20-4e35-81c9-78fd1a86f5ca tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:38.164474 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-25b3b780-1f20-4e35-81c9-78fd1a86f5ca tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1322 microversion: 2.1 time: 0.154238 Aug 04 22:24:38.165062 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 274/552] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:38 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:38.374328 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e07e46c8-f4ab-4865-b349-43def5b657b7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:38.375791 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e07e46c8-f4ab-4865-b349-43def5b657b7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:38.382814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e07e46c8-f4ab-4865-b349-43def5b657b7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:38.383283 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e07e46c8-f4ab-4865-b349-43def5b657b7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:38.383793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e07e46c8-f4ab-4865-b349-43def5b657b7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:38.384568 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e07e46c8-f4ab-4865-b349-43def5b657b7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:38.385251 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e07e46c8-f4ab-4865-b349-43def5b657b7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:38.385773 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e07e46c8-f4ab-4865-b349-43def5b657b7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:38.615215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e07e46c8-f4ab-4865-b349-43def5b657b7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:38.630063 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e07e46c8-f4ab-4865-b349-43def5b657b7 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1474 microversion: 2.1 time: 0.259709 Aug 04 22:24:38.630769 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 279/553] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:38 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1474 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:38.753311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-b4a00ae0-c725-4c8e-a073-a77b2223f807 req-92cde573-d125-4302-93d1-0d36a9600a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a8488c-d0a0-415d-915a-b65e92183864", "name": "network-vif-deleted", "tag": "aea24818-54c4-4a9e-b2f0-e6b50569da16"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:24:38.770876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-b4a00ae0-c725-4c8e-a073-a77b2223f807 req-92cde573-d125-4302-93d1-0d36a9600a89 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:38.771422 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-b4a00ae0-c725-4c8e-a073-a77b2223f807 req-92cde573-d125-4302-93d1-0d36a9600a89 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:38.772964 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-b4a00ae0-c725-4c8e-a073-a77b2223f807 req-92cde573-d125-4302-93d1-0d36a9600a89 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:38.805588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-b4a00ae0-c725-4c8e-a073-a77b2223f807 req-92cde573-d125-4302-93d1-0d36a9600a89 service nova] Creating event network-vif-deleted:aea24818-54c4-4a9e-b2f0-e6b50569da16 for instance a0a8488c-d0a0-415d-915a-b65e92183864 on hv-cinder-85221 Aug 04 22:24:38.810680 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-b4a00ae0-c725-4c8e-a073-a77b2223f807 req-92cde573-d125-4302-93d1-0d36a9600a89 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061736 Aug 04 22:24:38.811298 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 275/554] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:24:39.185777 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-640a4b4d-26cb-47f9-b2df-facb533fc84d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:39.186403 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-640a4b4d-26cb-47f9-b2df-facb533fc84d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:39.192757 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-640a4b4d-26cb-47f9-b2df-facb533fc84d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:39.193360 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-640a4b4d-26cb-47f9-b2df-facb533fc84d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:39.193818 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-640a4b4d-26cb-47f9-b2df-facb533fc84d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:39.194629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-640a4b4d-26cb-47f9-b2df-facb533fc84d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:39.195130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-640a4b4d-26cb-47f9-b2df-facb533fc84d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:39.195560 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-640a4b4d-26cb-47f9-b2df-facb533fc84d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:39.342597 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-640a4b4d-26cb-47f9-b2df-facb533fc84d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:39.352440 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-640a4b4d-26cb-47f9-b2df-facb533fc84d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1511 microversion: 2.1 time: 0.170673 Aug 04 22:24:39.353041 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 280/555] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:39 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:39.628384 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ea7155fd-ab7d-4115-b10d-933bd2e54fc8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:39.629069 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ea7155fd-ab7d-4115-b10d-933bd2e54fc8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:39.635084 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ea7155fd-ab7d-4115-b10d-933bd2e54fc8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:39.635634 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ea7155fd-ab7d-4115-b10d-933bd2e54fc8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:39.636130 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ea7155fd-ab7d-4115-b10d-933bd2e54fc8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:39.636895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ea7155fd-ab7d-4115-b10d-933bd2e54fc8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:39.637427 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ea7155fd-ab7d-4115-b10d-933bd2e54fc8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:39.637912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ea7155fd-ab7d-4115-b10d-933bd2e54fc8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:39.653009 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b9406793-a5dd-4400-b731-9abef98008f1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:39.653878 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b9406793-a5dd-4400-b731-9abef98008f1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:39.661965 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b9406793-a5dd-4400-b731-9abef98008f1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:39.662542 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b9406793-a5dd-4400-b731-9abef98008f1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:39.662721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ea7155fd-ab7d-4115-b10d-933bd2e54fc8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/ips" status: 200 len: 152 microversion: 2.20 time: 0.038862 Aug 04 22:24:39.662979 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b9406793-a5dd-4400-b731-9abef98008f1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:39.663429 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 276/556] 10.222.0.109 () {60 vars in 1294 bytes} [Thu Aug 4 22:24:39 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:24:39.663682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b9406793-a5dd-4400-b731-9abef98008f1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:39.664179 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b9406793-a5dd-4400-b731-9abef98008f1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:39.664558 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b9406793-a5dd-4400-b731-9abef98008f1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:39.741174 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b9406793-a5dd-4400-b731-9abef98008f1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:39.748686 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b9406793-a5dd-4400-b731-9abef98008f1 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1432 microversion: 2.1 time: 0.100461 Aug 04 22:24:39.761134 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 281/557] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:39 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1432 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:24:40.783681 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-02a223ec-083c-49c7-a2d0-4e72acb7e70c tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:40.784288 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-02a223ec-083c-49c7-a2d0-4e72acb7e70c tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:40.790894 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02a223ec-083c-49c7-a2d0-4e72acb7e70c tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:40.791382 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02a223ec-083c-49c7-a2d0-4e72acb7e70c tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:40.791817 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02a223ec-083c-49c7-a2d0-4e72acb7e70c tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:40.792516 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02a223ec-083c-49c7-a2d0-4e72acb7e70c tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:40.792968 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02a223ec-083c-49c7-a2d0-4e72acb7e70c tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:40.793393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02a223ec-083c-49c7-a2d0-4e72acb7e70c tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:40.857230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-02a223ec-083c-49c7-a2d0-4e72acb7e70c tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:40.865208 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-02a223ec-083c-49c7-a2d0-4e72acb7e70c tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1432 microversion: 2.1 time: 0.086049 Aug 04 22:24:40.865800 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 277/558] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:40 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1432 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:41.885883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f5199808-fff2-47a0-a9da-8b2c2d903ec4 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:41.886495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f5199808-fff2-47a0-a9da-8b2c2d903ec4 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:41.892605 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f5199808-fff2-47a0-a9da-8b2c2d903ec4 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:41.893086 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f5199808-fff2-47a0-a9da-8b2c2d903ec4 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:41.893617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f5199808-fff2-47a0-a9da-8b2c2d903ec4 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:41.894696 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f5199808-fff2-47a0-a9da-8b2c2d903ec4 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:41.895155 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f5199808-fff2-47a0-a9da-8b2c2d903ec4 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:41.895579 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f5199808-fff2-47a0-a9da-8b2c2d903ec4 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:41.966883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f5199808-fff2-47a0-a9da-8b2c2d903ec4 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:41.974795 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f5199808-fff2-47a0-a9da-8b2c2d903ec4 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1432 microversion: 2.1 time: 0.092652 Aug 04 22:24:41.975352 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 282/559] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:41 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1432 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:42.995793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-80bda50d-ba74-41b7-a979-709d963f4e06 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:42.996397 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-80bda50d-ba74-41b7-a979-709d963f4e06 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:43.003391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-80bda50d-ba74-41b7-a979-709d963f4e06 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:43.003865 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-80bda50d-ba74-41b7-a979-709d963f4e06 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:43.004293 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-80bda50d-ba74-41b7-a979-709d963f4e06 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:43.004974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-80bda50d-ba74-41b7-a979-709d963f4e06 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:43.005436 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-80bda50d-ba74-41b7-a979-709d963f4e06 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:43.005863 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-80bda50d-ba74-41b7-a979-709d963f4e06 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:43.070032 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-80bda50d-ba74-41b7-a979-709d963f4e06 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:43.077347 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-80bda50d-ba74-41b7-a979-709d963f4e06 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1432 microversion: 2.1 time: 0.085329 Aug 04 22:24:43.077980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 278/560] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:42 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1432 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:44.098977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:44.099597 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:44.105567 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:44.106058 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:44.106488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:44.107179 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:44.107627 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:44.108047 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:44.141090 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:44.141612 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:44.142049 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:44.142494 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.objects.instance [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lazy-loading 'fault' on Instance uuid a0a8488c-d0a0-415d-915a-b65e92183864 {{(pid=129197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:24:44.184596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35858dc56fdf4661a8aaffad520fc96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfbac5e5eab4e719af887179d6bcea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:44.193224 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a0325532-db75-4ae6-a38d-68989893b7be tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 200 len: 1309 microversion: 2.1 time: 0.097826 Aug 04 22:24:44.194045 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 283/561] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:44 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:24:45.218098 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5cf2ede5-b5f5-45f3-813f-a6d56df22922 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:45.219499 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5cf2ede5-b5f5-45f3-813f-a6d56df22922 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] [instance: a0a8488c-d0a0-415d-915a-b65e92183864] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:45.226859 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5cf2ede5-b5f5-45f3-813f-a6d56df22922 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:45.227387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5cf2ede5-b5f5-45f3-813f-a6d56df22922 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:45.227833 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5cf2ede5-b5f5-45f3-813f-a6d56df22922 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:45.228665 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5cf2ede5-b5f5-45f3-813f-a6d56df22922 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:45.229129 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5cf2ede5-b5f5-45f3-813f-a6d56df22922 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:45.229589 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5cf2ede5-b5f5-45f3-813f-a6d56df22922 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:45.249947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-5cf2ede5-b5f5-45f3-813f-a6d56df22922 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] HTTP exception thrown: Instance a0a8488c-d0a0-415d-915a-b65e92183864 could not be found. Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5cf2ede5-b5f5-45f3-813f-a6d56df22922 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Request method failure captured: Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 HTTP/1.1 Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EcBhXOYuo3yk_SybtrR0Y34dHnZWkSgSJ_qDmG2t4EJkA6c3eSAkiLRRZriApdAnGrKi9_dJE09IcRLPwKAMivxNyG0bTD76_VtJnuCHIX4zC01wTSXyf3ZCXM1cLWNeMxCiyvoRrod-6hXSW1kAmTTpT-OklsFkuJ5QQHpHo14HWM Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 8cfbac5e5eab4e719af887179d6bcea8 Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-VolumesNegativeTest-1630030575 Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:24:45.251784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:24:45.253535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/8cfbac5e5eab4e719af887179d6bcea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_8cfbac5e5eab4e719af887179d6bcea8", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/8cfbac5e5eab4e719af887179d6bcea8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/8cfbac5e5eab4e719af887179d6bcea8"}]}] Aug 04 22:24:45.253535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-VolumesNegativeTest-1630030575 Aug 04 22:24:45.253535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 8cfbac5e5eab4e719af887179d6bcea8 Aug 04 22:24:45.253535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-VolumesNegativeTest-1630030575 Aug 04 22:24:45.253535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-VolumesNegativeTest-1630030575-project Aug 04 22:24:45.253535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:24:45.253535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:24:45.253535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 35858dc56fdf4661a8aaffad520fc96f Aug 04 22:24:45.253535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-VolumesNegativeTest-1630030575-project Aug 04 22:24:45.253535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:24:45.253535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance a0a8488c-d0a0-415d-915a-b65e92183864 could not be found. Aug 04 22:24:45.253535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'a0a8488c-d0a0-415d-915a-b65e92183864'} Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a8488c-d0a0-415d-915a-b65e92183864 could not be found. Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:24:45.254365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a8488c-d0a0-415d-915a-b65e92183864 could not be found. Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a8488c-d0a0-415d-915a-b65e92183864 could not be found. Aug 04 22:24:45.255713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:24:45.257584 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5cf2ede5-b5f5-45f3-813f-a6d56df22922 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] Returning 404 to user: Instance a0a8488c-d0a0-415d-915a-b65e92183864 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:24:45.257584 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5cf2ede5-b5f5-45f3-813f-a6d56df22922 tempest-VolumesNegativeTest-1630030575 tempest-VolumesNegativeTest-1630030575-project] 10.222.0.109 "GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864" status: 404 len: 111 microversion: 2.1 time: 0.041699 Aug 04 22:24:45.257584 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 279/562] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:24:45 2022] GET /compute/v2.1/servers/a0a8488c-d0a0-415d-915a-b65e92183864 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:24:45.784764 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-41af01ba-47b4-440c-bbe5-edbd2db807d0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:24:45.785386 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-41af01ba-47b4-440c-bbe5-edbd2db807d0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:45.791656 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-41af01ba-47b4-440c-bbe5-edbd2db807d0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:45.792239 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-41af01ba-47b4-440c-bbe5-edbd2db807d0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:45.792741 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-41af01ba-47b4-440c-bbe5-edbd2db807d0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:45.793586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-41af01ba-47b4-440c-bbe5-edbd2db807d0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:45.794229 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-41af01ba-47b4-440c-bbe5-edbd2db807d0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:45.794651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-41af01ba-47b4-440c-bbe5-edbd2db807d0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:45.819090 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.objects.instance [None req-41af01ba-47b4-440c-bbe5-edbd2db807d0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lazy-loading 'flavor' on Instance uuid eb440660-4715-48f6-a7ff-f0b74dfefe21 {{(pid=129197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:24:46.011926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-41af01ba-47b4-440c-bbe5-edbd2db807d0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "POST /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/action" status: 202 len: 0 microversion: 2.20 time: 0.230910 Aug 04 22:24:46.012794 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 284/563] 10.222.0.109 () {62 vars in 1324 bytes} [Thu Aug 4 22:24:45 2022] POST /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:24:46.021161 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8654ad5b-8a3b-4764-88df-2cad937a082f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:46.021794 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8654ad5b-8a3b-4764-88df-2cad937a082f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:46.031852 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8654ad5b-8a3b-4764-88df-2cad937a082f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:46.040177 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8654ad5b-8a3b-4764-88df-2cad937a082f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:46.040847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8654ad5b-8a3b-4764-88df-2cad937a082f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:46.042005 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8654ad5b-8a3b-4764-88df-2cad937a082f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:46.042589 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8654ad5b-8a3b-4764-88df-2cad937a082f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:46.043183 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8654ad5b-8a3b-4764-88df-2cad937a082f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:46.193468 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8654ad5b-8a3b-4764-88df-2cad937a082f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:46.201505 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8654ad5b-8a3b-4764-88df-2cad937a082f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:46.203598 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8654ad5b-8a3b-4764-88df-2cad937a082f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:46.204740 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8654ad5b-8a3b-4764-88df-2cad937a082f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.187391 Aug 04 22:24:46.205288 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 280/564] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:24:46 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:24:47.228435 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3099e696-62c8-407c-99d5-b2c59b6c1853 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:47.229211 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3099e696-62c8-407c-99d5-b2c59b6c1853 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:47.237137 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3099e696-62c8-407c-99d5-b2c59b6c1853 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:47.237672 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3099e696-62c8-407c-99d5-b2c59b6c1853 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:47.238109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3099e696-62c8-407c-99d5-b2c59b6c1853 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:47.238809 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3099e696-62c8-407c-99d5-b2c59b6c1853 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:47.239522 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3099e696-62c8-407c-99d5-b2c59b6c1853 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:47.239999 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3099e696-62c8-407c-99d5-b2c59b6c1853 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:47.377586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3099e696-62c8-407c-99d5-b2c59b6c1853 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:47.385971 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3099e696-62c8-407c-99d5-b2c59b6c1853 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:47.387488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3099e696-62c8-407c-99d5-b2c59b6c1853 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:47.388644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3099e696-62c8-407c-99d5-b2c59b6c1853 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.164746 Aug 04 22:24:47.389187 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 285/565] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:24:47 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:24:48.411413 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0a3307cd-7534-463c-9302-d1da955dee3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:48.412017 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0a3307cd-7534-463c-9302-d1da955dee3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:48.418992 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0a3307cd-7534-463c-9302-d1da955dee3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:48.419464 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0a3307cd-7534-463c-9302-d1da955dee3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:48.419894 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0a3307cd-7534-463c-9302-d1da955dee3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:48.420570 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0a3307cd-7534-463c-9302-d1da955dee3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:48.421020 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0a3307cd-7534-463c-9302-d1da955dee3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:48.421544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0a3307cd-7534-463c-9302-d1da955dee3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:48.549974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0a3307cd-7534-463c-9302-d1da955dee3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:48.557829 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0a3307cd-7534-463c-9302-d1da955dee3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:48.559317 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0a3307cd-7534-463c-9302-d1da955dee3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:48.560452 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0a3307cd-7534-463c-9302-d1da955dee3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.152986 Aug 04 22:24:48.560996 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 281/566] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:24:48 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:24:49.583892 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4a072f36-d4e3-4161-8df4-2ed82efaabcb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:49.584499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4a072f36-d4e3-4161-8df4-2ed82efaabcb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:49.590506 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4a072f36-d4e3-4161-8df4-2ed82efaabcb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:49.591261 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4a072f36-d4e3-4161-8df4-2ed82efaabcb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:49.591692 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4a072f36-d4e3-4161-8df4-2ed82efaabcb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:49.592380 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4a072f36-d4e3-4161-8df4-2ed82efaabcb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:49.592831 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4a072f36-d4e3-4161-8df4-2ed82efaabcb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:49.593941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4a072f36-d4e3-4161-8df4-2ed82efaabcb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:49.722747 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4a072f36-d4e3-4161-8df4-2ed82efaabcb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:49.730742 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4a072f36-d4e3-4161-8df4-2ed82efaabcb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:49.732283 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4a072f36-d4e3-4161-8df4-2ed82efaabcb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:49.733450 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4a072f36-d4e3-4161-8df4-2ed82efaabcb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.153405 Aug 04 22:24:49.734247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 286/567] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:24:49 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:24:50.756123 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e1b1c9b5-7bbb-4d38-956d-0ded7a63b6e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:50.756731 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e1b1c9b5-7bbb-4d38-956d-0ded7a63b6e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:50.763252 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1b1c9b5-7bbb-4d38-956d-0ded7a63b6e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:50.763734 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1b1c9b5-7bbb-4d38-956d-0ded7a63b6e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:50.764167 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1b1c9b5-7bbb-4d38-956d-0ded7a63b6e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:50.764861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1b1c9b5-7bbb-4d38-956d-0ded7a63b6e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:50.765491 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1b1c9b5-7bbb-4d38-956d-0ded7a63b6e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:50.765925 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1b1c9b5-7bbb-4d38-956d-0ded7a63b6e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:50.896602 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e1b1c9b5-7bbb-4d38-956d-0ded7a63b6e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:50.904465 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e1b1c9b5-7bbb-4d38-956d-0ded7a63b6e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:50.907768 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e1b1c9b5-7bbb-4d38-956d-0ded7a63b6e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:50.909089 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e1b1c9b5-7bbb-4d38-956d-0ded7a63b6e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.156751 Aug 04 22:24:50.909849 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 282/568] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:24:50 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:24:51.933761 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d9bb18d3-9d9a-46a0-ba4b-b16717164f6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:51.934437 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d9bb18d3-9d9a-46a0-ba4b-b16717164f6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:51.936468 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=50 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:51.942165 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d9bb18d3-9d9a-46a0-ba4b-b16717164f6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:51.942656 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d9bb18d3-9d9a-46a0-ba4b-b16717164f6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:51.943118 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d9bb18d3-9d9a-46a0-ba4b-b16717164f6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:51.943819 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d9bb18d3-9d9a-46a0-ba4b-b16717164f6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:51.944282 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d9bb18d3-9d9a-46a0-ba4b-b16717164f6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:51.944708 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d9bb18d3-9d9a-46a0-ba4b-b16717164f6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:52.081710 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d9bb18d3-9d9a-46a0-ba4b-b16717164f6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:52.089984 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d9bb18d3-9d9a-46a0-ba4b-b16717164f6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:52.091521 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d9bb18d3-9d9a-46a0-ba4b-b16717164f6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:52.092671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d9bb18d3-9d9a-46a0-ba4b-b16717164f6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.162949 Aug 04 22:24:52.093897 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 287/569] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:24:51 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:24:53.116783 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-18c4b7c1-f68c-4d0a-80f8-2300365bfdcf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:53.120094 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-18c4b7c1-f68c-4d0a-80f8-2300365bfdcf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:53.127519 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-18c4b7c1-f68c-4d0a-80f8-2300365bfdcf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:53.128055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-18c4b7c1-f68c-4d0a-80f8-2300365bfdcf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:53.128800 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-18c4b7c1-f68c-4d0a-80f8-2300365bfdcf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:53.129197 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-18c4b7c1-f68c-4d0a-80f8-2300365bfdcf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:53.129688 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-18c4b7c1-f68c-4d0a-80f8-2300365bfdcf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:53.130110 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-18c4b7c1-f68c-4d0a-80f8-2300365bfdcf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:53.260065 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-18c4b7c1-f68c-4d0a-80f8-2300365bfdcf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:53.268517 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-18c4b7c1-f68c-4d0a-80f8-2300365bfdcf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:53.270037 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-18c4b7c1-f68c-4d0a-80f8-2300365bfdcf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:53.271174 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-18c4b7c1-f68c-4d0a-80f8-2300365bfdcf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.158639 Aug 04 22:24:53.272004 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 283/570] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:24:53 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:24:54.294894 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-65786de2-ab34-441c-a541-de9eea716d90 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:54.295551 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-65786de2-ab34-441c-a541-de9eea716d90 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:54.304033 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-65786de2-ab34-441c-a541-de9eea716d90 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:54.304518 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-65786de2-ab34-441c-a541-de9eea716d90 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:54.304984 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-65786de2-ab34-441c-a541-de9eea716d90 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:54.305728 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-65786de2-ab34-441c-a541-de9eea716d90 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:54.306183 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-65786de2-ab34-441c-a541-de9eea716d90 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:54.306607 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-65786de2-ab34-441c-a541-de9eea716d90 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:54.440530 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-65786de2-ab34-441c-a541-de9eea716d90 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:54.448332 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-65786de2-ab34-441c-a541-de9eea716d90 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:54.449852 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-65786de2-ab34-441c-a541-de9eea716d90 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:54.451004 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-65786de2-ab34-441c-a541-de9eea716d90 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.160257 Aug 04 22:24:54.451553 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 288/571] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:24:54 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:24:55.474335 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a49d2df5-0eb0-4254-8446-9c2908651370 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:55.475186 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a49d2df5-0eb0-4254-8446-9c2908651370 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:55.481298 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a49d2df5-0eb0-4254-8446-9c2908651370 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:55.481810 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a49d2df5-0eb0-4254-8446-9c2908651370 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:55.482240 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a49d2df5-0eb0-4254-8446-9c2908651370 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:55.482918 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a49d2df5-0eb0-4254-8446-9c2908651370 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:55.483912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a49d2df5-0eb0-4254-8446-9c2908651370 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:55.484333 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a49d2df5-0eb0-4254-8446-9c2908651370 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:55.620481 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a49d2df5-0eb0-4254-8446-9c2908651370 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:55.629040 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a49d2df5-0eb0-4254-8446-9c2908651370 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:55.630561 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a49d2df5-0eb0-4254-8446-9c2908651370 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:55.631701 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a49d2df5-0eb0-4254-8446-9c2908651370 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.161443 Aug 04 22:24:55.632255 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 284/572] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:24:55 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:24:56.657437 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6d258365-1264-418d-8a35-2af7876da3e7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:56.658134 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6d258365-1264-418d-8a35-2af7876da3e7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:56.664729 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6d258365-1264-418d-8a35-2af7876da3e7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:56.665219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6d258365-1264-418d-8a35-2af7876da3e7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:56.665697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6d258365-1264-418d-8a35-2af7876da3e7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:56.666634 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6d258365-1264-418d-8a35-2af7876da3e7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:56.667096 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6d258365-1264-418d-8a35-2af7876da3e7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:56.667528 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6d258365-1264-418d-8a35-2af7876da3e7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:56.671975 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:24:56.809828 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6d258365-1264-418d-8a35-2af7876da3e7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:56.818327 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6d258365-1264-418d-8a35-2af7876da3e7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:56.819808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6d258365-1264-418d-8a35-2af7876da3e7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:56.821007 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6d258365-1264-418d-8a35-2af7876da3e7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.168199 Aug 04 22:24:56.821590 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 289/573] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:24:56 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:24:57.844061 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-be7f9c75-3ac8-4ff1-9b68-6ccbf35c7671 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:57.845380 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-be7f9c75-3ac8-4ff1-9b68-6ccbf35c7671 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:57.852195 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-be7f9c75-3ac8-4ff1-9b68-6ccbf35c7671 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:57.852680 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-be7f9c75-3ac8-4ff1-9b68-6ccbf35c7671 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:57.853107 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-be7f9c75-3ac8-4ff1-9b68-6ccbf35c7671 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:57.853830 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-be7f9c75-3ac8-4ff1-9b68-6ccbf35c7671 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:57.854284 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-be7f9c75-3ac8-4ff1-9b68-6ccbf35c7671 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:57.854704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-be7f9c75-3ac8-4ff1-9b68-6ccbf35c7671 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:58.017790 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-be7f9c75-3ac8-4ff1-9b68-6ccbf35c7671 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:58.026486 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-be7f9c75-3ac8-4ff1-9b68-6ccbf35c7671 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:58.028046 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-be7f9c75-3ac8-4ff1-9b68-6ccbf35c7671 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:58.029227 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-be7f9c75-3ac8-4ff1-9b68-6ccbf35c7671 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.189381 Aug 04 22:24:58.030112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 285/574] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:24:57 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:24:59.053505 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-aff021c2-aefb-416a-8ca7-8f6f23b5f6cc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:24:59.054048 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-aff021c2-aefb-416a-8ca7-8f6f23b5f6cc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:24:59.060426 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aff021c2-aefb-416a-8ca7-8f6f23b5f6cc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:59.061532 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aff021c2-aefb-416a-8ca7-8f6f23b5f6cc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:59.061893 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aff021c2-aefb-416a-8ca7-8f6f23b5f6cc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:59.062615 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aff021c2-aefb-416a-8ca7-8f6f23b5f6cc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:24:59.063071 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aff021c2-aefb-416a-8ca7-8f6f23b5f6cc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:24:59.063500 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aff021c2-aefb-416a-8ca7-8f6f23b5f6cc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:24:59.197126 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-aff021c2-aefb-416a-8ca7-8f6f23b5f6cc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:59.206656 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-aff021c2-aefb-416a-8ca7-8f6f23b5f6cc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:59.208161 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-aff021c2-aefb-416a-8ca7-8f6f23b5f6cc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:24:59.209315 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-aff021c2-aefb-416a-8ca7-8f6f23b5f6cc tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.159866 Aug 04 22:24:59.209898 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 290/575] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:24:59 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:00.232488 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a09f19f8-7211-4ec1-8e04-3860c1a5ef02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:00.234191 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a09f19f8-7211-4ec1-8e04-3860c1a5ef02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:00.236214 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:00.242183 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a09f19f8-7211-4ec1-8e04-3860c1a5ef02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:00.242673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a09f19f8-7211-4ec1-8e04-3860c1a5ef02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:00.243114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a09f19f8-7211-4ec1-8e04-3860c1a5ef02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:00.243818 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a09f19f8-7211-4ec1-8e04-3860c1a5ef02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:00.244278 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a09f19f8-7211-4ec1-8e04-3860c1a5ef02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:00.244703 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a09f19f8-7211-4ec1-8e04-3860c1a5ef02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:00.378030 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a09f19f8-7211-4ec1-8e04-3860c1a5ef02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:00.385935 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a09f19f8-7211-4ec1-8e04-3860c1a5ef02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:00.387441 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a09f19f8-7211-4ec1-8e04-3860c1a5ef02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:00.388591 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a09f19f8-7211-4ec1-8e04-3860c1a5ef02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.160261 Aug 04 22:25:00.389194 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 286/576] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:00 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:01.410827 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6bb7c415-5995-434a-bc97-8495658c5622 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:01.411526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6bb7c415-5995-434a-bc97-8495658c5622 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:01.417236 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6bb7c415-5995-434a-bc97-8495658c5622 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:01.417750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6bb7c415-5995-434a-bc97-8495658c5622 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:01.418182 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6bb7c415-5995-434a-bc97-8495658c5622 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:01.418868 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6bb7c415-5995-434a-bc97-8495658c5622 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:01.419313 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6bb7c415-5995-434a-bc97-8495658c5622 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:01.419736 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6bb7c415-5995-434a-bc97-8495658c5622 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:01.553005 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6bb7c415-5995-434a-bc97-8495658c5622 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:01.562135 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6bb7c415-5995-434a-bc97-8495658c5622 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:01.563639 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6bb7c415-5995-434a-bc97-8495658c5622 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:01.564826 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6bb7c415-5995-434a-bc97-8495658c5622 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.157953 Aug 04 22:25:01.565421 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 291/577] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:01 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:02.588051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1a4929db-a86e-41c6-9bd8-91c183b22700 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:02.588662 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1a4929db-a86e-41c6-9bd8-91c183b22700 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:02.596050 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1a4929db-a86e-41c6-9bd8-91c183b22700 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:02.596534 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1a4929db-a86e-41c6-9bd8-91c183b22700 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:02.596972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1a4929db-a86e-41c6-9bd8-91c183b22700 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:02.597694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1a4929db-a86e-41c6-9bd8-91c183b22700 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:02.598157 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1a4929db-a86e-41c6-9bd8-91c183b22700 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:02.598585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1a4929db-a86e-41c6-9bd8-91c183b22700 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:02.601112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=98 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:02.726615 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1a4929db-a86e-41c6-9bd8-91c183b22700 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:02.734840 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1a4929db-a86e-41c6-9bd8-91c183b22700 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:02.736674 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1a4929db-a86e-41c6-9bd8-91c183b22700 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:02.737894 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1a4929db-a86e-41c6-9bd8-91c183b22700 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.153774 Aug 04 22:25:02.738718 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 287/578] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:02 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:03.761308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d0957fcd-bb9a-459b-acd5-80e5bdb50080 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:03.761852 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d0957fcd-bb9a-459b-acd5-80e5bdb50080 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:03.768478 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d0957fcd-bb9a-459b-acd5-80e5bdb50080 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:03.768970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d0957fcd-bb9a-459b-acd5-80e5bdb50080 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:03.769478 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d0957fcd-bb9a-459b-acd5-80e5bdb50080 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:03.770185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d0957fcd-bb9a-459b-acd5-80e5bdb50080 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:03.770647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d0957fcd-bb9a-459b-acd5-80e5bdb50080 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:03.771189 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d0957fcd-bb9a-459b-acd5-80e5bdb50080 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:03.906581 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d0957fcd-bb9a-459b-acd5-80e5bdb50080 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:03.916566 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d0957fcd-bb9a-459b-acd5-80e5bdb50080 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:03.918090 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d0957fcd-bb9a-459b-acd5-80e5bdb50080 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:03.919239 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d0957fcd-bb9a-459b-acd5-80e5bdb50080 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.161973 Aug 04 22:25:03.919818 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 292/579] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:03 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:04.953421 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b55c13bc-33c6-4bfe-accd-18a989883a88 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:04.954454 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b55c13bc-33c6-4bfe-accd-18a989883a88 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:04.960970 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b55c13bc-33c6-4bfe-accd-18a989883a88 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:04.961478 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b55c13bc-33c6-4bfe-accd-18a989883a88 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:04.961913 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b55c13bc-33c6-4bfe-accd-18a989883a88 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:04.962597 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b55c13bc-33c6-4bfe-accd-18a989883a88 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:04.963044 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b55c13bc-33c6-4bfe-accd-18a989883a88 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:04.963458 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b55c13bc-33c6-4bfe-accd-18a989883a88 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:05.096384 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b55c13bc-33c6-4bfe-accd-18a989883a88 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:05.104660 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b55c13bc-33c6-4bfe-accd-18a989883a88 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:05.106249 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b55c13bc-33c6-4bfe-accd-18a989883a88 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:05.107390 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b55c13bc-33c6-4bfe-accd-18a989883a88 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.167089 Aug 04 22:25:05.120776 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 288/580] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:04 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:06.130224 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e554bde9-64e8-4e59-8280-30d63eff51a3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:06.130867 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e554bde9-64e8-4e59-8280-30d63eff51a3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:06.136821 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e554bde9-64e8-4e59-8280-30d63eff51a3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:06.137298 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e554bde9-64e8-4e59-8280-30d63eff51a3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:06.137765 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e554bde9-64e8-4e59-8280-30d63eff51a3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:06.138983 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e554bde9-64e8-4e59-8280-30d63eff51a3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:06.139654 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e554bde9-64e8-4e59-8280-30d63eff51a3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:06.140080 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e554bde9-64e8-4e59-8280-30d63eff51a3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:06.275824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e554bde9-64e8-4e59-8280-30d63eff51a3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:06.285015 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e554bde9-64e8-4e59-8280-30d63eff51a3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:06.286526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e554bde9-64e8-4e59-8280-30d63eff51a3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:06.287670 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e554bde9-64e8-4e59-8280-30d63eff51a3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.161380 Aug 04 22:25:06.288217 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 293/581] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:06 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:07.314798 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-bb64269d-3bfc-46ad-9277-536c9f70bd7f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:07.315412 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-bb64269d-3bfc-46ad-9277-536c9f70bd7f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:07.321787 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bb64269d-3bfc-46ad-9277-536c9f70bd7f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:07.322270 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bb64269d-3bfc-46ad-9277-536c9f70bd7f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:07.322706 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bb64269d-3bfc-46ad-9277-536c9f70bd7f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:07.323393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bb64269d-3bfc-46ad-9277-536c9f70bd7f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:07.323854 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bb64269d-3bfc-46ad-9277-536c9f70bd7f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:07.324280 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bb64269d-3bfc-46ad-9277-536c9f70bd7f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:07.453280 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-bb64269d-3bfc-46ad-9277-536c9f70bd7f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:07.461167 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-bb64269d-3bfc-46ad-9277-536c9f70bd7f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:07.462699 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-bb64269d-3bfc-46ad-9277-536c9f70bd7f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:07.463844 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-bb64269d-3bfc-46ad-9277-536c9f70bd7f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.153438 Aug 04 22:25:07.464403 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 289/582] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:07 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:08.486934 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-db26a0ff-adaa-4384-84ab-873fc77d206b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:08.487573 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-db26a0ff-adaa-4384-84ab-873fc77d206b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:08.493878 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-db26a0ff-adaa-4384-84ab-873fc77d206b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:08.494359 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-db26a0ff-adaa-4384-84ab-873fc77d206b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:08.494793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-db26a0ff-adaa-4384-84ab-873fc77d206b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:08.495479 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-db26a0ff-adaa-4384-84ab-873fc77d206b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:08.495936 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-db26a0ff-adaa-4384-84ab-873fc77d206b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:08.496361 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-db26a0ff-adaa-4384-84ab-873fc77d206b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:08.624765 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-db26a0ff-adaa-4384-84ab-873fc77d206b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:08.632901 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-db26a0ff-adaa-4384-84ab-873fc77d206b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:08.634420 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-db26a0ff-adaa-4384-84ab-873fc77d206b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:08.635560 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-db26a0ff-adaa-4384-84ab-873fc77d206b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1749 microversion: 2.20 time: 0.153113 Aug 04 22:25:08.636123 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 294/583] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:08 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:09.659305 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-80f5f637-2653-4c1b-9ed0-c726e8886027 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:09.659918 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-80f5f637-2653-4c1b-9ed0-c726e8886027 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:09.666381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-80f5f637-2653-4c1b-9ed0-c726e8886027 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:09.666863 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-80f5f637-2653-4c1b-9ed0-c726e8886027 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:09.667305 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-80f5f637-2653-4c1b-9ed0-c726e8886027 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:09.667992 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-80f5f637-2653-4c1b-9ed0-c726e8886027 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:09.668447 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-80f5f637-2653-4c1b-9ed0-c726e8886027 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:09.668874 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-80f5f637-2653-4c1b-9ed0-c726e8886027 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:09.800972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-80f5f637-2653-4c1b-9ed0-c726e8886027 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:09.809152 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-80f5f637-2653-4c1b-9ed0-c726e8886027 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:09.810708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-80f5f637-2653-4c1b-9ed0-c726e8886027 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:09.812435 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-80f5f637-2653-4c1b-9ed0-c726e8886027 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1749 microversion: 2.20 time: 0.157525 Aug 04 22:25:09.812998 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 290/584] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:09 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:10.835655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-93e73d16-0fdc-41fe-aa2f-f82d07d2be18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:10.836272 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-93e73d16-0fdc-41fe-aa2f-f82d07d2be18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:10.842841 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93e73d16-0fdc-41fe-aa2f-f82d07d2be18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:10.843476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93e73d16-0fdc-41fe-aa2f-f82d07d2be18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:10.843921 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93e73d16-0fdc-41fe-aa2f-f82d07d2be18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:10.844622 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93e73d16-0fdc-41fe-aa2f-f82d07d2be18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:10.845079 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93e73d16-0fdc-41fe-aa2f-f82d07d2be18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:10.845534 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93e73d16-0fdc-41fe-aa2f-f82d07d2be18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:11.129064 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-93e73d16-0fdc-41fe-aa2f-f82d07d2be18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:11.136933 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-93e73d16-0fdc-41fe-aa2f-f82d07d2be18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:11.138477 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-93e73d16-0fdc-41fe-aa2f-f82d07d2be18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:11.140243 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-93e73d16-0fdc-41fe-aa2f-f82d07d2be18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1749 microversion: 2.20 time: 0.308477 Aug 04 22:25:11.140835 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 295/585] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:10 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1749 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:12.012164 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f6dc39c9-896f-4848-b22b-b82fc4ff659b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:12.012763 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f6dc39c9-896f-4848-b22b-b82fc4ff659b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:12.019817 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f6dc39c9-896f-4848-b22b-b82fc4ff659b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:12.020308 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f6dc39c9-896f-4848-b22b-b82fc4ff659b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:12.020750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f6dc39c9-896f-4848-b22b-b82fc4ff659b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:12.021474 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f6dc39c9-896f-4848-b22b-b82fc4ff659b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:12.021934 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f6dc39c9-896f-4848-b22b-b82fc4ff659b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:12.022361 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f6dc39c9-896f-4848-b22b-b82fc4ff659b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:12.047562 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f6dc39c9-896f-4848-b22b-b82fc4ff659b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/ips" status: 200 len: 151 microversion: 2.1 time: 0.039434 Aug 04 22:25:12.048131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 291/586] 10.222.0.109 () {58 vars in 1253 bytes} [Thu Aug 4 22:25:12 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:25:12.162647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a45784ce-dfce-4771-9006-c483bea49f3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:12.163273 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a45784ce-dfce-4771-9006-c483bea49f3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:12.169696 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a45784ce-dfce-4771-9006-c483bea49f3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:12.170190 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a45784ce-dfce-4771-9006-c483bea49f3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:12.170647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a45784ce-dfce-4771-9006-c483bea49f3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:12.171720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a45784ce-dfce-4771-9006-c483bea49f3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:12.172184 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a45784ce-dfce-4771-9006-c483bea49f3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:12.172624 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a45784ce-dfce-4771-9006-c483bea49f3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:12.325659 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a45784ce-dfce-4771-9006-c483bea49f3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:12.331309 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a45784ce-dfce-4771-9006-c483bea49f3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:12.332824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a45784ce-dfce-4771-9006-c483bea49f3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:12.334029 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a45784ce-dfce-4771-9006-c483bea49f3b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1749 microversion: 2.20 time: 0.175249 Aug 04 22:25:12.334581 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 296/587] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:12 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:13.356126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3b128305-bab5-428c-9b92-844fd7b63a76 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:13.356763 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3b128305-bab5-428c-9b92-844fd7b63a76 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:13.364112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b128305-bab5-428c-9b92-844fd7b63a76 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:13.364529 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b128305-bab5-428c-9b92-844fd7b63a76 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:13.364964 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b128305-bab5-428c-9b92-844fd7b63a76 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:13.365669 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b128305-bab5-428c-9b92-844fd7b63a76 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:13.366116 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b128305-bab5-428c-9b92-844fd7b63a76 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:13.366536 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b128305-bab5-428c-9b92-844fd7b63a76 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:13.575758 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3b128305-bab5-428c-9b92-844fd7b63a76 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:13.584771 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3b128305-bab5-428c-9b92-844fd7b63a76 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:13.586694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3b128305-bab5-428c-9b92-844fd7b63a76 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:13.587903 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3b128305-bab5-428c-9b92-844fd7b63a76 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1749 microversion: 2.20 time: 0.235615 Aug 04 22:25:13.588565 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 292/588] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:13 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1749 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:13.886133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-61ccb123-b458-4e68-ba8d-0459cc9999c4 req-b3c4d55b-ebe6-4615-a952-119d49331631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb440660-4715-48f6-a7ff-f0b74dfefe21", "name": "network-vif-plugged", "status": "completed", "tag": "417dd402-4a58-49ce-a237-c5d14b0ce44d"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:25:13.896660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-61ccb123-b458-4e68-ba8d-0459cc9999c4 req-b3c4d55b-ebe6-4615-a952-119d49331631 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:13.897170 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-61ccb123-b458-4e68-ba8d-0459cc9999c4 req-b3c4d55b-ebe6-4615-a952-119d49331631 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:13.897716 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-61ccb123-b458-4e68-ba8d-0459cc9999c4 req-b3c4d55b-ebe6-4615-a952-119d49331631 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:13.909349 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-61ccb123-b458-4e68-ba8d-0459cc9999c4 req-b3c4d55b-ebe6-4615-a952-119d49331631 service nova] Creating event network-vif-plugged:417dd402-4a58-49ce-a237-c5d14b0ce44d for instance eb440660-4715-48f6-a7ff-f0b74dfefe21 on hv-cinder-85221 Aug 04 22:25:13.914878 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-61ccb123-b458-4e68-ba8d-0459cc9999c4 req-b3c4d55b-ebe6-4615-a952-119d49331631 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032494 Aug 04 22:25:13.915551 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 297/589] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:25:14.493568 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-faa1079f-6298-4107-8e85-0d3e3da5c59f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38197de4-0a66-4917-9ad8-58382d035e37"}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:25:14.495958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-faa1079f-6298-4107-8e85-0d3e3da5c59f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:14.502950 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-faa1079f-6298-4107-8e85-0d3e3da5c59f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:14.503425 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-faa1079f-6298-4107-8e85-0d3e3da5c59f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:14.503855 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-faa1079f-6298-4107-8e85-0d3e3da5c59f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:14.504529 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-faa1079f-6298-4107-8e85-0d3e3da5c59f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:14.504974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-faa1079f-6298-4107-8e85-0d3e3da5c59f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:14.505390 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-faa1079f-6298-4107-8e85-0d3e3da5c59f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:14.613588 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-266d2821-3b51-4090-ae1a-1c7b91de807a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:14.614326 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-266d2821-3b51-4090-ae1a-1c7b91de807a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:14.620814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-266d2821-3b51-4090-ae1a-1c7b91de807a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:14.621304 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-266d2821-3b51-4090-ae1a-1c7b91de807a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:14.621812 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-266d2821-3b51-4090-ae1a-1c7b91de807a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:14.622571 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-266d2821-3b51-4090-ae1a-1c7b91de807a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:14.623030 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-266d2821-3b51-4090-ae1a-1c7b91de807a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:14.623576 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-266d2821-3b51-4090-ae1a-1c7b91de807a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:14.759749 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-266d2821-3b51-4090-ae1a-1c7b91de807a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:14.768277 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-266d2821-3b51-4090-ae1a-1c7b91de807a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:14.769971 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-266d2821-3b51-4090-ae1a-1c7b91de807a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:14.771147 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-266d2821-3b51-4090-ae1a-1c7b91de807a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1749 microversion: 2.20 time: 0.163216 Aug 04 22:25:14.771702 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 298/590] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:14 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:25:14.778745 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-faa1079f-6298-4107-8e85-0d3e3da5c59f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "POST /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288874 Aug 04 22:25:14.785084 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 293/591] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:25:14 2022] POST /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:25:15.794133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7fcd51ef-1c4c-4371-a0bb-685d736c7665 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:15.794647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7fcd51ef-1c4c-4371-a0bb-685d736c7665 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:15.801380 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7fcd51ef-1c4c-4371-a0bb-685d736c7665 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:15.801894 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7fcd51ef-1c4c-4371-a0bb-685d736c7665 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:15.802328 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7fcd51ef-1c4c-4371-a0bb-685d736c7665 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:15.803020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7fcd51ef-1c4c-4371-a0bb-685d736c7665 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:15.803476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7fcd51ef-1c4c-4371-a0bb-685d736c7665 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:15.803902 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7fcd51ef-1c4c-4371-a0bb-685d736c7665 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:15.939323 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7fcd51ef-1c4c-4371-a0bb-685d736c7665 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:15.947942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7fcd51ef-1c4c-4371-a0bb-685d736c7665 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:15.949824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7fcd51ef-1c4c-4371-a0bb-685d736c7665 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:15.951076 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7fcd51ef-1c4c-4371-a0bb-685d736c7665 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1749 microversion: 2.20 time: 0.160916 Aug 04 22:25:15.952050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 299/592] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:15 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:16.727984 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ae745420-25aa-4c30-92dd-c901db73d870 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50b38f3f-b8a9-4dd4-99f3-14d396cb7933", "device": "/dev/sdb"}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:25:16.730994 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ae745420-25aa-4c30-92dd-c901db73d870 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:16.737589 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ae745420-25aa-4c30-92dd-c901db73d870 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:16.738338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ae745420-25aa-4c30-92dd-c901db73d870 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:16.738773 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ae745420-25aa-4c30-92dd-c901db73d870 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:16.739462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ae745420-25aa-4c30-92dd-c901db73d870 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:16.739911 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ae745420-25aa-4c30-92dd-c901db73d870 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:16.740333 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ae745420-25aa-4c30-92dd-c901db73d870 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:17.029579 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ae745420-25aa-4c30-92dd-c901db73d870 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "POST /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306031 Aug 04 22:25:17.030537 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 294/593] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:25:16 2022] POST /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:25:17.086815 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-8e52a561-d45f-4480-ba5f-d11f0153e84a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:17.090726 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-8e52a561-d45f-4480-ba5f-d11f0153e84a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:17.096959 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8e52a561-d45f-4480-ba5f-d11f0153e84a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:17.097338 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8e52a561-d45f-4480-ba5f-d11f0153e84a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:17.097917 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8e52a561-d45f-4480-ba5f-d11f0153e84a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:17.098615 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8e52a561-d45f-4480-ba5f-d11f0153e84a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:17.099067 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8e52a561-d45f-4480-ba5f-d11f0153e84a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:17.099492 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8e52a561-d45f-4480-ba5f-d11f0153e84a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:17.231713 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8e52a561-d45f-4480-ba5f-d11f0153e84a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:17.240505 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8e52a561-d45f-4480-ba5f-d11f0153e84a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:17.242136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8e52a561-d45f-4480-ba5f-d11f0153e84a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:17.243293 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-8e52a561-d45f-4480-ba5f-d11f0153e84a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1749 microversion: 2.20 time: 0.273074 Aug 04 22:25:17.243857 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 300/594] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:16 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1749 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:25:18.266697 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d70527a0-cf89-4a69-9464-e3228b578c07 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:18.267523 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d70527a0-cf89-4a69-9464-e3228b578c07 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:18.274505 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d70527a0-cf89-4a69-9464-e3228b578c07 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:18.275111 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d70527a0-cf89-4a69-9464-e3228b578c07 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:18.275653 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d70527a0-cf89-4a69-9464-e3228b578c07 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:18.276457 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d70527a0-cf89-4a69-9464-e3228b578c07 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:18.277016 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d70527a0-cf89-4a69-9464-e3228b578c07 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:18.277576 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d70527a0-cf89-4a69-9464-e3228b578c07 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:18.438369 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d70527a0-cf89-4a69-9464-e3228b578c07 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:18.446677 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d70527a0-cf89-4a69-9464-e3228b578c07 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:18.449588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d70527a0-cf89-4a69-9464-e3228b578c07 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:18.450980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d70527a0-cf89-4a69-9464-e3228b578c07 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1744 microversion: 2.20 time: 0.189097 Aug 04 22:25:18.452240 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 295/595] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:18 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:19.475650 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2670429e-8a3d-4e0c-8695-7a1dc522a3f2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:19.477060 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2670429e-8a3d-4e0c-8695-7a1dc522a3f2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:19.483637 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2670429e-8a3d-4e0c-8695-7a1dc522a3f2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:19.484384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2670429e-8a3d-4e0c-8695-7a1dc522a3f2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:19.485039 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2670429e-8a3d-4e0c-8695-7a1dc522a3f2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:19.485989 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2670429e-8a3d-4e0c-8695-7a1dc522a3f2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:19.486799 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2670429e-8a3d-4e0c-8695-7a1dc522a3f2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:19.487441 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2670429e-8a3d-4e0c-8695-7a1dc522a3f2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:19.646875 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2670429e-8a3d-4e0c-8695-7a1dc522a3f2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:19.657814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2670429e-8a3d-4e0c-8695-7a1dc522a3f2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:19.659729 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2670429e-8a3d-4e0c-8695-7a1dc522a3f2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:19.660811 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2670429e-8a3d-4e0c-8695-7a1dc522a3f2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1744 microversion: 2.20 time: 0.189161 Aug 04 22:25:19.661554 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 301/596] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:19 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:20.690611 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3bfeb3e9-bb58-4b15-97f2-59bae9b048d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:20.691285 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3bfeb3e9-bb58-4b15-97f2-59bae9b048d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:20.706960 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3bfeb3e9-bb58-4b15-97f2-59bae9b048d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:20.707578 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3bfeb3e9-bb58-4b15-97f2-59bae9b048d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:20.708024 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3bfeb3e9-bb58-4b15-97f2-59bae9b048d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:20.708757 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3bfeb3e9-bb58-4b15-97f2-59bae9b048d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:20.709213 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3bfeb3e9-bb58-4b15-97f2-59bae9b048d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:20.715212 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3bfeb3e9-bb58-4b15-97f2-59bae9b048d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:20.865778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3bfeb3e9-bb58-4b15-97f2-59bae9b048d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:20.876730 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3bfeb3e9-bb58-4b15-97f2-59bae9b048d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:20.879253 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3bfeb3e9-bb58-4b15-97f2-59bae9b048d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:20.880423 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3bfeb3e9-bb58-4b15-97f2-59bae9b048d1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1744 microversion: 2.20 time: 0.199739 Aug 04 22:25:20.880986 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 296/597] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:20 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1744 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:21.903777 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bca18cab-2562-426d-9779-a04202c6384f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:21.905941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bca18cab-2562-426d-9779-a04202c6384f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:21.913088 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bca18cab-2562-426d-9779-a04202c6384f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:21.913652 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bca18cab-2562-426d-9779-a04202c6384f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:21.914091 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bca18cab-2562-426d-9779-a04202c6384f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:21.915096 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bca18cab-2562-426d-9779-a04202c6384f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:21.916255 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bca18cab-2562-426d-9779-a04202c6384f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:21.917349 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bca18cab-2562-426d-9779-a04202c6384f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:22.072394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bca18cab-2562-426d-9779-a04202c6384f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:22.082247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bca18cab-2562-426d-9779-a04202c6384f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:22.083998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bca18cab-2562-426d-9779-a04202c6384f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:22.085345 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bca18cab-2562-426d-9779-a04202c6384f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1744 microversion: 2.20 time: 0.185501 Aug 04 22:25:22.100939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 302/598] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:21 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1744 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:25:22.363446 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-50f63c9e-b765-4c84-b45b-d054a6e22700 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Action: 'create', calling method: .version_select at 0x7fe7b206e5e0>, body: {"keypair": {"name": "tempest-keypair-1552336069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDod7Ry+0mOw6aIWmVW1Ir2hWwWONzdDckWfjVQebBl9CxwEnqw8uAojnP75rcHU607TNOn0UDr/Km55lEIk0hTkdg11pKzgqHxqikpCI7HzRR9LQrbGwetk9ojPt5BdlQ=="}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:25:22.401977 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-50f63c9e-b765-4c84-b45b-d054a6e22700 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for project 011b296da6654fa38f76eadd7bebae6f. Resources: {'key_pairs'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:25:22.410832 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-50f63c9e-b765-4c84-b45b-d054a6e22700 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for user 8c50160e51b54cde9a3f617d71fbf1c0 and project 011b296da6654fa38f76eadd7bebae6f. Resources: {'key_pairs'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:25:22.489306 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-50f63c9e-b765-4c84-b45b-d054a6e22700 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129687 Aug 04 22:25:22.496230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 297/599] 10.222.0.109 () {60 vars in 1164 bytes} [Thu Aug 4 22:25:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:25:23.115176 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d0d6313e-5418-447b-b2e5-1f996412c29d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:23.115882 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d0d6313e-5418-447b-b2e5-1f996412c29d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:23.128145 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=32 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:23.139045 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d0d6313e-5418-447b-b2e5-1f996412c29d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:23.140308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d0d6313e-5418-447b-b2e5-1f996412c29d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:23.142827 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d0d6313e-5418-447b-b2e5-1f996412c29d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:23.143803 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d0d6313e-5418-447b-b2e5-1f996412c29d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:23.144229 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d0d6313e-5418-447b-b2e5-1f996412c29d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:23.144653 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d0d6313e-5418-447b-b2e5-1f996412c29d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:23.413388 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d0d6313e-5418-447b-b2e5-1f996412c29d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:23.427931 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d0d6313e-5418-447b-b2e5-1f996412c29d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:23.429539 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d0d6313e-5418-447b-b2e5-1f996412c29d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:23.430801 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d0d6313e-5418-447b-b2e5-1f996412c29d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1744 microversion: 2.20 time: 0.325300 Aug 04 22:25:23.434894 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 303/600] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:23 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1744 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:24.176706 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1037433263", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b91150e-ffb3-48d1-826e-331e5df87d0e"}], "security_groups": [{"name": "tempest-securitygroup--1083520057"}], "key_name": "tempest-keypair-1552336069", "user_data": "}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:25:24.314074 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.network.neutron [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] validate_networks() for [('7b91150e-ffb3-48d1-826e-331e5df87d0e', None, None, None, None, None)] {{(pid=129196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:25:24.460149 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7e07b0ba-007a-49ea-a95b-3d74de57dd45 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:24.460794 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7e07b0ba-007a-49ea-a95b-3d74de57dd45 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:24.467554 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e07b0ba-007a-49ea-a95b-3d74de57dd45 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:24.468346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e07b0ba-007a-49ea-a95b-3d74de57dd45 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:24.469016 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e07b0ba-007a-49ea-a95b-3d74de57dd45 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:24.469970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e07b0ba-007a-49ea-a95b-3d74de57dd45 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:24.470642 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e07b0ba-007a-49ea-a95b-3d74de57dd45 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:24.471278 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e07b0ba-007a-49ea-a95b-3d74de57dd45 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:24.782948 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7e07b0ba-007a-49ea-a95b-3d74de57dd45 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:24.800186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7e07b0ba-007a-49ea-a95b-3d74de57dd45 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:24.804026 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7e07b0ba-007a-49ea-a95b-3d74de57dd45 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:24.805901 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7e07b0ba-007a-49ea-a95b-3d74de57dd45 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1744 microversion: 2.20 time: 0.349754 Aug 04 22:25:24.806734 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Flavor limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:25:24.807154 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Image limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:25:24.807494 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 304/601] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:24 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1744 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:25:24.807820 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Flavor pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:25:24.808376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Image pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:25:24.808957 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:25:24.822394 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:24.823153 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:24.823833 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:24.825182 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:24.827740 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:24.828516 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:24.853889 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for project 011b296da6654fa38f76eadd7bebae6f. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:25:24.858978 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for user 8c50160e51b54cde9a3f617d71fbf1c0 and project 011b296da6654fa38f76eadd7bebae6f. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:25:24.871451 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Going to run 1 instances... {{(pid=129196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:25:24.874689 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:25:24.941653 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c65ed146-411d-4139-9b6c-334c3d8cc8d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.773723 Aug 04 22:25:24.944091 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 298/602] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:25:24 2022] POST /compute/v2.1/servers => generated 404 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:25:24.955089 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3502d8a8-8e96-4db5-b89b-36fef184a658 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:24.955711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3502d8a8-8e96-4db5-b89b-36fef184a658 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:25.055288 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3502d8a8-8e96-4db5-b89b-36fef184a658 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:25.067846 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3502d8a8-8e96-4db5-b89b-36fef184a658 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1246 microversion: 2.1 time: 0.116560 Aug 04 22:25:25.068442 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 305/603] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:24 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1246 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:25.834048 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9990b9dc-4acd-4638-844d-1dfcc435d967 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:25.834794 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9990b9dc-4acd-4638-844d-1dfcc435d967 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:25.842269 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9990b9dc-4acd-4638-844d-1dfcc435d967 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:25.842761 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9990b9dc-4acd-4638-844d-1dfcc435d967 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:25.843199 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9990b9dc-4acd-4638-844d-1dfcc435d967 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:25.843907 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9990b9dc-4acd-4638-844d-1dfcc435d967 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:25.844489 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9990b9dc-4acd-4638-844d-1dfcc435d967 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:25.845118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9990b9dc-4acd-4638-844d-1dfcc435d967 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:26.006042 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9990b9dc-4acd-4638-844d-1dfcc435d967 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:26.016377 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9990b9dc-4acd-4638-844d-1dfcc435d967 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:26.018225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9990b9dc-4acd-4638-844d-1dfcc435d967 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:26.019425 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9990b9dc-4acd-4638-844d-1dfcc435d967 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1744 microversion: 2.20 time: 0.190345 Aug 04 22:25:26.019986 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 299/604] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:25 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1744 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:26.088451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-62277204-7b37-4427-b8fe-f22fc5ecbd87 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:26.089727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-62277204-7b37-4427-b8fe-f22fc5ecbd87 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:26.097117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62277204-7b37-4427-b8fe-f22fc5ecbd87 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:26.097838 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62277204-7b37-4427-b8fe-f22fc5ecbd87 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:26.098483 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62277204-7b37-4427-b8fe-f22fc5ecbd87 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:26.099183 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62277204-7b37-4427-b8fe-f22fc5ecbd87 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:26.099812 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62277204-7b37-4427-b8fe-f22fc5ecbd87 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:26.100238 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-62277204-7b37-4427-b8fe-f22fc5ecbd87 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:26.166224 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-62277204-7b37-4427-b8fe-f22fc5ecbd87 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:26.175050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-62277204-7b37-4427-b8fe-f22fc5ecbd87 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1298 microversion: 2.1 time: 0.090660 Aug 04 22:25:26.176760 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 306/605] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:26 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:25:27.043060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f00ae2ca-853e-4680-889a-3ac8e5c2d217 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:27.043671 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f00ae2ca-853e-4680-889a-3ac8e5c2d217 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:27.052593 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f00ae2ca-853e-4680-889a-3ac8e5c2d217 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:27.053073 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f00ae2ca-853e-4680-889a-3ac8e5c2d217 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:27.053548 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f00ae2ca-853e-4680-889a-3ac8e5c2d217 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:27.054239 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f00ae2ca-853e-4680-889a-3ac8e5c2d217 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:27.054688 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f00ae2ca-853e-4680-889a-3ac8e5c2d217 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:27.055104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f00ae2ca-853e-4680-889a-3ac8e5c2d217 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:27.195965 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-fa35eeea-0653-487e-8054-179e19a86b26 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:27.196784 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-fa35eeea-0653-487e-8054-179e19a86b26 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:27.209120 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fa35eeea-0653-487e-8054-179e19a86b26 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:27.209593 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fa35eeea-0653-487e-8054-179e19a86b26 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:27.210038 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fa35eeea-0653-487e-8054-179e19a86b26 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:27.210751 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fa35eeea-0653-487e-8054-179e19a86b26 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:27.211210 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fa35eeea-0653-487e-8054-179e19a86b26 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:27.211637 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fa35eeea-0653-487e-8054-179e19a86b26 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:27.224512 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f00ae2ca-853e-4680-889a-3ac8e5c2d217 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:27.229042 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=98 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:27.236934 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f00ae2ca-853e-4680-889a-3ac8e5c2d217 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:27.238894 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f00ae2ca-853e-4680-889a-3ac8e5c2d217 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:27.240104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f00ae2ca-853e-4680-889a-3ac8e5c2d217 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1744 microversion: 2.20 time: 0.200906 Aug 04 22:25:27.255391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 300/606] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:27 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1744 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:27.477995 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-fa35eeea-0653-487e-8054-179e19a86b26 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:27.491447 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-fa35eeea-0653-487e-8054-179e19a86b26 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.296457 Aug 04 22:25:27.492374 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 307/607] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:27 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:25:28.209068 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-c5c1d823-ad7f-47e6-8d41-6519f58191e2 req-e46b9b69-3e70-4b9f-8759-c7e2a2ace9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b377be43-9cb6-4bf2-9702-a280d8cc51b9", "tag": "74713ddd-d0bb-4812-8557-156b3e19e333"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:25:28.219563 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-c5c1d823-ad7f-47e6-8d41-6519f58191e2 req-e46b9b69-3e70-4b9f-8759-c7e2a2ace9e5 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:28.220076 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-c5c1d823-ad7f-47e6-8d41-6519f58191e2 req-e46b9b69-3e70-4b9f-8759-c7e2a2ace9e5 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:28.220512 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-c5c1d823-ad7f-47e6-8d41-6519f58191e2 req-e46b9b69-3e70-4b9f-8759-c7e2a2ace9e5 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:28.235315 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-c5c1d823-ad7f-47e6-8d41-6519f58191e2 req-e46b9b69-3e70-4b9f-8759-c7e2a2ace9e5 service nova] Creating event network-changed:74713ddd-d0bb-4812-8557-156b3e19e333 for instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 on hv-cinder-85221 Aug 04 22:25:28.240704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-c5c1d823-ad7f-47e6-8d41-6519f58191e2 req-e46b9b69-3e70-4b9f-8759-c7e2a2ace9e5 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035410 Aug 04 22:25:28.241311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 301/608] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:25:28.274220 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-207bea4b-583f-438d-ba01-4f34b7619ec2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:28.274963 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-207bea4b-583f-438d-ba01-4f34b7619ec2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:28.281082 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-207bea4b-583f-438d-ba01-4f34b7619ec2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:28.281613 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-207bea4b-583f-438d-ba01-4f34b7619ec2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:28.282060 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-207bea4b-583f-438d-ba01-4f34b7619ec2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:28.282784 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-207bea4b-583f-438d-ba01-4f34b7619ec2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:28.283244 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-207bea4b-583f-438d-ba01-4f34b7619ec2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:28.283672 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-207bea4b-583f-438d-ba01-4f34b7619ec2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:28.413591 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-207bea4b-583f-438d-ba01-4f34b7619ec2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:28.421617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-207bea4b-583f-438d-ba01-4f34b7619ec2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:28.423155 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-207bea4b-583f-438d-ba01-4f34b7619ec2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:28.424361 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-207bea4b-583f-438d-ba01-4f34b7619ec2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1744 microversion: 2.20 time: 0.154103 Aug 04 22:25:28.424954 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 308/609] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:28 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:28.512571 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7f991b96-6d36-4014-ab6d-d6ee080d7e8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:28.513326 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7f991b96-6d36-4014-ab6d-d6ee080d7e8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:28.519593 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7f991b96-6d36-4014-ab6d-d6ee080d7e8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:28.520097 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7f991b96-6d36-4014-ab6d-d6ee080d7e8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:28.520524 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7f991b96-6d36-4014-ab6d-d6ee080d7e8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:28.521201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7f991b96-6d36-4014-ab6d-d6ee080d7e8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:28.521686 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7f991b96-6d36-4014-ab6d-d6ee080d7e8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:28.522105 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7f991b96-6d36-4014-ab6d-d6ee080d7e8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:28.655211 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7f991b96-6d36-4014-ab6d-d6ee080d7e8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:28.662615 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7f991b96-6d36-4014-ab6d-d6ee080d7e8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.154235 Aug 04 22:25:28.663182 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 302/610] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:28 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:29.447469 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-60a0090e-ba5b-42e2-846a-ce352da92248 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:29.448023 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-60a0090e-ba5b-42e2-846a-ce352da92248 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:29.454617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60a0090e-ba5b-42e2-846a-ce352da92248 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:29.455101 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60a0090e-ba5b-42e2-846a-ce352da92248 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:29.455541 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60a0090e-ba5b-42e2-846a-ce352da92248 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:29.456241 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60a0090e-ba5b-42e2-846a-ce352da92248 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:29.456697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60a0090e-ba5b-42e2-846a-ce352da92248 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:29.457127 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60a0090e-ba5b-42e2-846a-ce352da92248 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:29.587687 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-60a0090e-ba5b-42e2-846a-ce352da92248 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:29.595444 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-60a0090e-ba5b-42e2-846a-ce352da92248 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:29.596932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-60a0090e-ba5b-42e2-846a-ce352da92248 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:29.598100 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-60a0090e-ba5b-42e2-846a-ce352da92248 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.154650 Aug 04 22:25:29.598658 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 309/611] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:29 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:29.684397 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f1b261b5-479e-420a-884a-894d165fe1d9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:29.685531 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f1b261b5-479e-420a-884a-894d165fe1d9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:29.691768 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f1b261b5-479e-420a-884a-894d165fe1d9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:29.692243 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f1b261b5-479e-420a-884a-894d165fe1d9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:29.692670 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f1b261b5-479e-420a-884a-894d165fe1d9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:29.693349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f1b261b5-479e-420a-884a-894d165fe1d9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:29.693818 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f1b261b5-479e-420a-884a-894d165fe1d9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:29.694242 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f1b261b5-479e-420a-884a-894d165fe1d9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:29.840242 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f1b261b5-479e-420a-884a-894d165fe1d9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:29.843393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:29.849814 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f1b261b5-479e-420a-884a-894d165fe1d9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.169047 Aug 04 22:25:29.850395 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 303/612] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:29 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:30.621227 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f0ec73d2-f884-41a2-94e2-6e759d37f462 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:30.621856 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f0ec73d2-f884-41a2-94e2-6e759d37f462 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:30.628728 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f0ec73d2-f884-41a2-94e2-6e759d37f462 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:30.629208 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f0ec73d2-f884-41a2-94e2-6e759d37f462 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:30.629661 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f0ec73d2-f884-41a2-94e2-6e759d37f462 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:30.630350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f0ec73d2-f884-41a2-94e2-6e759d37f462 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:30.630798 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f0ec73d2-f884-41a2-94e2-6e759d37f462 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:30.631215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f0ec73d2-f884-41a2-94e2-6e759d37f462 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:30.768305 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f0ec73d2-f884-41a2-94e2-6e759d37f462 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:30.776861 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f0ec73d2-f884-41a2-94e2-6e759d37f462 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:30.778411 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f0ec73d2-f884-41a2-94e2-6e759d37f462 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:30.779547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f0ec73d2-f884-41a2-94e2-6e759d37f462 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.162179 Aug 04 22:25:30.780117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 310/613] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:30 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:30.927548 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a9ae9199-136f-4af7-94e2-90bf175e8b59 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:30.928202 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a9ae9199-136f-4af7-94e2-90bf175e8b59 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:30.930098 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:30.936193 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a9ae9199-136f-4af7-94e2-90bf175e8b59 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:30.936669 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a9ae9199-136f-4af7-94e2-90bf175e8b59 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:30.937095 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a9ae9199-136f-4af7-94e2-90bf175e8b59 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:30.937810 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a9ae9199-136f-4af7-94e2-90bf175e8b59 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:30.938256 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a9ae9199-136f-4af7-94e2-90bf175e8b59 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:30.938673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a9ae9199-136f-4af7-94e2-90bf175e8b59 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:31.068251 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a9ae9199-136f-4af7-94e2-90bf175e8b59 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:31.075609 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a9ae9199-136f-4af7-94e2-90bf175e8b59 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.209665 Aug 04 22:25:31.076175 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 304/614] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:30 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:31.802398 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-82a69e23-1679-44d2-88b0-eb894cf74256 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:31.803052 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-82a69e23-1679-44d2-88b0-eb894cf74256 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:31.808918 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-82a69e23-1679-44d2-88b0-eb894cf74256 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:31.809392 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-82a69e23-1679-44d2-88b0-eb894cf74256 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:31.809849 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-82a69e23-1679-44d2-88b0-eb894cf74256 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:31.811230 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-82a69e23-1679-44d2-88b0-eb894cf74256 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:31.811683 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-82a69e23-1679-44d2-88b0-eb894cf74256 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:31.812102 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-82a69e23-1679-44d2-88b0-eb894cf74256 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:31.942221 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-82a69e23-1679-44d2-88b0-eb894cf74256 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:31.950093 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-82a69e23-1679-44d2-88b0-eb894cf74256 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:31.952371 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-82a69e23-1679-44d2-88b0-eb894cf74256 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:31.953547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-82a69e23-1679-44d2-88b0-eb894cf74256 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.154993 Aug 04 22:25:31.954105 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 311/615] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:31 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:25:32.095751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-db65bc47-3c25-4c45-9902-82ffe901965b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:32.096384 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-db65bc47-3c25-4c45-9902-82ffe901965b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:32.103260 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-db65bc47-3c25-4c45-9902-82ffe901965b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:32.103779 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-db65bc47-3c25-4c45-9902-82ffe901965b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:32.104511 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-db65bc47-3c25-4c45-9902-82ffe901965b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:32.104902 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-db65bc47-3c25-4c45-9902-82ffe901965b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:32.105352 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-db65bc47-3c25-4c45-9902-82ffe901965b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:32.105993 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-db65bc47-3c25-4c45-9902-82ffe901965b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:32.236783 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-db65bc47-3c25-4c45-9902-82ffe901965b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:32.244377 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-db65bc47-3c25-4c45-9902-82ffe901965b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.152443 Aug 04 22:25:32.244934 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 305/616] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:32 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:32.978485 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-20c532fd-822b-414b-9140-88109fc5a104 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:32.979192 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-20c532fd-822b-414b-9140-88109fc5a104 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:32.985260 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20c532fd-822b-414b-9140-88109fc5a104 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:32.985774 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20c532fd-822b-414b-9140-88109fc5a104 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:32.986211 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20c532fd-822b-414b-9140-88109fc5a104 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:32.986907 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20c532fd-822b-414b-9140-88109fc5a104 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:32.987635 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20c532fd-822b-414b-9140-88109fc5a104 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:32.988087 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20c532fd-822b-414b-9140-88109fc5a104 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:33.120962 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-20c532fd-822b-414b-9140-88109fc5a104 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:33.129024 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-20c532fd-822b-414b-9140-88109fc5a104 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:33.130566 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-20c532fd-822b-414b-9140-88109fc5a104 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:33.131708 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-20c532fd-822b-414b-9140-88109fc5a104 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.159400 Aug 04 22:25:33.132293 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 312/617] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:32 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:33.265592 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ad7e10e9-2af4-4b11-b7fc-98e33f40301a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:33.266219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ad7e10e9-2af4-4b11-b7fc-98e33f40301a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:33.272961 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ad7e10e9-2af4-4b11-b7fc-98e33f40301a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:33.273479 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ad7e10e9-2af4-4b11-b7fc-98e33f40301a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:33.273917 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ad7e10e9-2af4-4b11-b7fc-98e33f40301a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:33.274635 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ad7e10e9-2af4-4b11-b7fc-98e33f40301a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:33.275067 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ad7e10e9-2af4-4b11-b7fc-98e33f40301a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:33.275493 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ad7e10e9-2af4-4b11-b7fc-98e33f40301a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:33.415228 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-ad7e10e9-2af4-4b11-b7fc-98e33f40301a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:33.423938 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ad7e10e9-2af4-4b11-b7fc-98e33f40301a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.162282 Aug 04 22:25:33.424537 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 306/618] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:33 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:34.154925 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-feac85ea-c98c-4c67-b7dd-f340fbae4a8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:34.155539 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-feac85ea-c98c-4c67-b7dd-f340fbae4a8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:34.161513 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-feac85ea-c98c-4c67-b7dd-f340fbae4a8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:34.161994 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-feac85ea-c98c-4c67-b7dd-f340fbae4a8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:34.162429 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-feac85ea-c98c-4c67-b7dd-f340fbae4a8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:34.163113 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-feac85ea-c98c-4c67-b7dd-f340fbae4a8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:34.163565 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-feac85ea-c98c-4c67-b7dd-f340fbae4a8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:34.163987 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-feac85ea-c98c-4c67-b7dd-f340fbae4a8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:34.292525 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-feac85ea-c98c-4c67-b7dd-f340fbae4a8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:34.300817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-feac85ea-c98c-4c67-b7dd-f340fbae4a8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:34.302338 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-feac85ea-c98c-4c67-b7dd-f340fbae4a8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:34.303467 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-feac85ea-c98c-4c67-b7dd-f340fbae4a8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.152402 Aug 04 22:25:34.304020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 313/619] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:34 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:34.445024 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c509c54a-7379-4730-be93-e6047df9b4e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:34.445600 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c509c54a-7379-4730-be93-e6047df9b4e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:34.452958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c509c54a-7379-4730-be93-e6047df9b4e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:34.453462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c509c54a-7379-4730-be93-e6047df9b4e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:34.453896 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c509c54a-7379-4730-be93-e6047df9b4e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:34.454571 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c509c54a-7379-4730-be93-e6047df9b4e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:34.455019 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c509c54a-7379-4730-be93-e6047df9b4e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:34.455437 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c509c54a-7379-4730-be93-e6047df9b4e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:34.584336 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c509c54a-7379-4730-be93-e6047df9b4e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:34.592236 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c509c54a-7379-4730-be93-e6047df9b4e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.151210 Aug 04 22:25:34.592800 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 307/620] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:34 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:35.274133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-79c76ebc-97b9-4129-959b-3e8c3a0def25 req-38f08830-cc43-4f86-a51d-1a65ee6f736d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb440660-4715-48f6-a7ff-f0b74dfefe21", "name": "network-vif-unplugged", "status": "completed", "tag": "417dd402-4a58-49ce-a237-c5d14b0ce44d"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:25:35.280830 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:35.288404 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-79c76ebc-97b9-4129-959b-3e8c3a0def25 req-38f08830-cc43-4f86-a51d-1a65ee6f736d service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:35.288888 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-79c76ebc-97b9-4129-959b-3e8c3a0def25 req-38f08830-cc43-4f86-a51d-1a65ee6f736d service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:35.289326 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-79c76ebc-97b9-4129-959b-3e8c3a0def25 req-38f08830-cc43-4f86-a51d-1a65ee6f736d service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:35.300867 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-79c76ebc-97b9-4129-959b-3e8c3a0def25 req-38f08830-cc43-4f86-a51d-1a65ee6f736d service nova] Creating event network-vif-unplugged:417dd402-4a58-49ce-a237-c5d14b0ce44d for instance eb440660-4715-48f6-a7ff-f0b74dfefe21 on hv-cinder-85221 Aug 04 22:25:35.306454 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-79c76ebc-97b9-4129-959b-3e8c3a0def25 req-38f08830-cc43-4f86-a51d-1a65ee6f736d service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036882 Aug 04 22:25:35.307057 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 314/621] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:25:35.325994 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b6a3a656-f1e5-4faf-b36a-0c8d9bf2731b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:35.326725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b6a3a656-f1e5-4faf-b36a-0c8d9bf2731b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:35.328632 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:35.329569 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=10 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:35.335198 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b6a3a656-f1e5-4faf-b36a-0c8d9bf2731b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:35.340588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b6a3a656-f1e5-4faf-b36a-0c8d9bf2731b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:35.341127 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b6a3a656-f1e5-4faf-b36a-0c8d9bf2731b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:35.342003 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b6a3a656-f1e5-4faf-b36a-0c8d9bf2731b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:35.342470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b6a3a656-f1e5-4faf-b36a-0c8d9bf2731b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:35.342908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b6a3a656-f1e5-4faf-b36a-0c8d9bf2731b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:35.476557 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b6a3a656-f1e5-4faf-b36a-0c8d9bf2731b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:35.485161 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b6a3a656-f1e5-4faf-b36a-0c8d9bf2731b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:35.486709 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b6a3a656-f1e5-4faf-b36a-0c8d9bf2731b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:35.488117 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b6a3a656-f1e5-4faf-b36a-0c8d9bf2731b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.166527 Aug 04 22:25:35.488669 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 308/622] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:35 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:35.613074 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-50bde3f7-91bd-47fd-8b61-e8d8b0ca102b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:35.613801 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-50bde3f7-91bd-47fd-8b61-e8d8b0ca102b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:35.620012 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50bde3f7-91bd-47fd-8b61-e8d8b0ca102b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:35.620439 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50bde3f7-91bd-47fd-8b61-e8d8b0ca102b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:35.620873 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50bde3f7-91bd-47fd-8b61-e8d8b0ca102b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:35.621595 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50bde3f7-91bd-47fd-8b61-e8d8b0ca102b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:35.622050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50bde3f7-91bd-47fd-8b61-e8d8b0ca102b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:35.622643 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-50bde3f7-91bd-47fd-8b61-e8d8b0ca102b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:35.758393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-50bde3f7-91bd-47fd-8b61-e8d8b0ca102b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:35.766665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-50bde3f7-91bd-47fd-8b61-e8d8b0ca102b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.158021 Aug 04 22:25:35.767239 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 315/623] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:35 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:36.511179 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b60188da-d83f-4dd5-8591-0e360599d0c0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:36.511818 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b60188da-d83f-4dd5-8591-0e360599d0c0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:36.519737 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b60188da-d83f-4dd5-8591-0e360599d0c0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:36.520224 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b60188da-d83f-4dd5-8591-0e360599d0c0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:36.520775 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b60188da-d83f-4dd5-8591-0e360599d0c0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:36.521355 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b60188da-d83f-4dd5-8591-0e360599d0c0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:36.522007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b60188da-d83f-4dd5-8591-0e360599d0c0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:36.522437 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b60188da-d83f-4dd5-8591-0e360599d0c0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:36.664137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b60188da-d83f-4dd5-8591-0e360599d0c0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:36.673439 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b60188da-d83f-4dd5-8591-0e360599d0c0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:36.674922 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b60188da-d83f-4dd5-8591-0e360599d0c0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:36.676079 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b60188da-d83f-4dd5-8591-0e360599d0c0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.168775 Aug 04 22:25:36.676635 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 309/624] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:36 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:36.787256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d80e04ba-ab03-4993-8f1c-929bc458f781 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:36.787876 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d80e04ba-ab03-4993-8f1c-929bc458f781 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:36.793879 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d80e04ba-ab03-4993-8f1c-929bc458f781 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:36.794863 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d80e04ba-ab03-4993-8f1c-929bc458f781 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:36.795301 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d80e04ba-ab03-4993-8f1c-929bc458f781 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:36.796083 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d80e04ba-ab03-4993-8f1c-929bc458f781 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:36.796543 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d80e04ba-ab03-4993-8f1c-929bc458f781 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:36.796970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d80e04ba-ab03-4993-8f1c-929bc458f781 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:36.928039 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d80e04ba-ab03-4993-8f1c-929bc458f781 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:36.936103 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d80e04ba-ab03-4993-8f1c-929bc458f781 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.152793 Aug 04 22:25:36.936674 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 316/625] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:36 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:37.699446 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a09a223f-9dc6-4a7d-8495-b5683acfc843 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:37.700039 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a09a223f-9dc6-4a7d-8495-b5683acfc843 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:37.707001 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a09a223f-9dc6-4a7d-8495-b5683acfc843 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:37.707487 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a09a223f-9dc6-4a7d-8495-b5683acfc843 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:37.707928 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a09a223f-9dc6-4a7d-8495-b5683acfc843 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:37.708616 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a09a223f-9dc6-4a7d-8495-b5683acfc843 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:37.709073 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a09a223f-9dc6-4a7d-8495-b5683acfc843 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:37.709533 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a09a223f-9dc6-4a7d-8495-b5683acfc843 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:37.842381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a09a223f-9dc6-4a7d-8495-b5683acfc843 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:37.850202 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a09a223f-9dc6-4a7d-8495-b5683acfc843 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:37.851694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a09a223f-9dc6-4a7d-8495-b5683acfc843 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:37.852880 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a09a223f-9dc6-4a7d-8495-b5683acfc843 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.157286 Aug 04 22:25:37.853479 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 310/626] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:37 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:37.957035 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7b6e1d59-8df5-42cc-892d-06d91a2be3d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:37.957673 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7b6e1d59-8df5-42cc-892d-06d91a2be3d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:37.963716 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b6e1d59-8df5-42cc-892d-06d91a2be3d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:37.964207 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b6e1d59-8df5-42cc-892d-06d91a2be3d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:37.964648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b6e1d59-8df5-42cc-892d-06d91a2be3d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:37.965341 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b6e1d59-8df5-42cc-892d-06d91a2be3d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:37.965835 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b6e1d59-8df5-42cc-892d-06d91a2be3d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:37.966260 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b6e1d59-8df5-42cc-892d-06d91a2be3d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:38.093076 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7b6e1d59-8df5-42cc-892d-06d91a2be3d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:38.100525 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7b6e1d59-8df5-42cc-892d-06d91a2be3d2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.147336 Aug 04 22:25:38.101116 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 317/627] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:37 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:38.875766 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0ef91c96-e367-44cd-aa27-2297b9a79f27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:38.876316 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0ef91c96-e367-44cd-aa27-2297b9a79f27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:38.882742 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0ef91c96-e367-44cd-aa27-2297b9a79f27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:38.883221 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0ef91c96-e367-44cd-aa27-2297b9a79f27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:38.883656 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0ef91c96-e367-44cd-aa27-2297b9a79f27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:38.884352 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0ef91c96-e367-44cd-aa27-2297b9a79f27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:38.884809 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0ef91c96-e367-44cd-aa27-2297b9a79f27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:38.885234 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0ef91c96-e367-44cd-aa27-2297b9a79f27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:39.015321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0ef91c96-e367-44cd-aa27-2297b9a79f27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:39.023320 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0ef91c96-e367-44cd-aa27-2297b9a79f27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:39.024825 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0ef91c96-e367-44cd-aa27-2297b9a79f27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:39.026020 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0ef91c96-e367-44cd-aa27-2297b9a79f27 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.154248 Aug 04 22:25:39.026576 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 311/628] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:38 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:39.121229 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ae5015ee-3f6d-4bbe-b93b-f60f3154509d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:39.121864 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ae5015ee-3f6d-4bbe-b93b-f60f3154509d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:39.128218 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ae5015ee-3f6d-4bbe-b93b-f60f3154509d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:39.128632 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ae5015ee-3f6d-4bbe-b93b-f60f3154509d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:39.129056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ae5015ee-3f6d-4bbe-b93b-f60f3154509d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:39.129763 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ae5015ee-3f6d-4bbe-b93b-f60f3154509d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:39.130218 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ae5015ee-3f6d-4bbe-b93b-f60f3154509d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:39.130631 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ae5015ee-3f6d-4bbe-b93b-f60f3154509d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:39.261773 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ae5015ee-3f6d-4bbe-b93b-f60f3154509d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:39.269959 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ae5015ee-3f6d-4bbe-b93b-f60f3154509d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.152483 Aug 04 22:25:39.270526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 318/629] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:39 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:40.049112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-954efa47-ce84-439b-b030-af6885301d17 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:40.049712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-954efa47-ce84-439b-b030-af6885301d17 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:40.056065 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-954efa47-ce84-439b-b030-af6885301d17 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:40.056540 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-954efa47-ce84-439b-b030-af6885301d17 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:40.056970 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-954efa47-ce84-439b-b030-af6885301d17 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:40.057680 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-954efa47-ce84-439b-b030-af6885301d17 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:40.058132 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-954efa47-ce84-439b-b030-af6885301d17 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:40.058557 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-954efa47-ce84-439b-b030-af6885301d17 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:40.186609 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-954efa47-ce84-439b-b030-af6885301d17 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:40.195035 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-954efa47-ce84-439b-b030-af6885301d17 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:40.196552 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-954efa47-ce84-439b-b030-af6885301d17 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:40.197732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-954efa47-ce84-439b-b030-af6885301d17 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.152579 Aug 04 22:25:40.198291 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 312/630] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:40 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:40.290830 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-655fca4c-72d9-43d1-b244-e6a713bcb09f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:40.291449 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-655fca4c-72d9-43d1-b244-e6a713bcb09f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:40.297603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-655fca4c-72d9-43d1-b244-e6a713bcb09f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:40.298093 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-655fca4c-72d9-43d1-b244-e6a713bcb09f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:40.298531 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-655fca4c-72d9-43d1-b244-e6a713bcb09f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:40.299277 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-655fca4c-72d9-43d1-b244-e6a713bcb09f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:40.299688 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-655fca4c-72d9-43d1-b244-e6a713bcb09f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:40.300115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-655fca4c-72d9-43d1-b244-e6a713bcb09f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:40.428680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-655fca4c-72d9-43d1-b244-e6a713bcb09f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:40.436078 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-655fca4c-72d9-43d1-b244-e6a713bcb09f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.149067 Aug 04 22:25:40.436642 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 319/631] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:40 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:25:41.221646 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-41a1ab3f-e651-4c85-949c-7bedd679d1a0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:41.222262 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-41a1ab3f-e651-4c85-949c-7bedd679d1a0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:41.228772 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-41a1ab3f-e651-4c85-949c-7bedd679d1a0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:41.229297 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-41a1ab3f-e651-4c85-949c-7bedd679d1a0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:41.229755 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-41a1ab3f-e651-4c85-949c-7bedd679d1a0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:41.230437 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-41a1ab3f-e651-4c85-949c-7bedd679d1a0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:41.230894 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-41a1ab3f-e651-4c85-949c-7bedd679d1a0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:41.231312 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-41a1ab3f-e651-4c85-949c-7bedd679d1a0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:41.366154 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-41a1ab3f-e651-4c85-949c-7bedd679d1a0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:41.374039 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-41a1ab3f-e651-4c85-949c-7bedd679d1a0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:41.375547 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-41a1ab3f-e651-4c85-949c-7bedd679d1a0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:41.376698 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-41a1ab3f-e651-4c85-949c-7bedd679d1a0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.159665 Aug 04 22:25:41.377262 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 313/632] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:41 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:41.458105 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b6524915-7dca-436c-a050-351a453841fe tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:41.458735 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b6524915-7dca-436c-a050-351a453841fe tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:41.465050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6524915-7dca-436c-a050-351a453841fe tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:41.465597 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6524915-7dca-436c-a050-351a453841fe tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:41.466033 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6524915-7dca-436c-a050-351a453841fe tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:41.466740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6524915-7dca-436c-a050-351a453841fe tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:41.467174 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6524915-7dca-436c-a050-351a453841fe tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:41.467597 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6524915-7dca-436c-a050-351a453841fe tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:41.601183 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b6524915-7dca-436c-a050-351a453841fe tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:41.608645 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b6524915-7dca-436c-a050-351a453841fe tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.156086 Aug 04 22:25:41.609214 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 320/633] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:41 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:42.400267 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-738ef0f2-f944-45ec-8862-aead5627728b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:42.400812 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-738ef0f2-f944-45ec-8862-aead5627728b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:42.408200 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-738ef0f2-f944-45ec-8862-aead5627728b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:42.408680 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-738ef0f2-f944-45ec-8862-aead5627728b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:42.409113 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-738ef0f2-f944-45ec-8862-aead5627728b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:42.409834 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-738ef0f2-f944-45ec-8862-aead5627728b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:42.410289 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-738ef0f2-f944-45ec-8862-aead5627728b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:42.410712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-738ef0f2-f944-45ec-8862-aead5627728b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:42.542220 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-738ef0f2-f944-45ec-8862-aead5627728b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:42.550936 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-738ef0f2-f944-45ec-8862-aead5627728b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:42.552418 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-738ef0f2-f944-45ec-8862-aead5627728b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:42.553597 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-738ef0f2-f944-45ec-8862-aead5627728b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.157294 Aug 04 22:25:42.554153 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 314/634] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:42 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:42.629686 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e6b484a4-6dbc-4d78-96b0-c0ac7211eb89 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:42.630303 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e6b484a4-6dbc-4d78-96b0-c0ac7211eb89 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:42.636237 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e6b484a4-6dbc-4d78-96b0-c0ac7211eb89 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:42.636722 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e6b484a4-6dbc-4d78-96b0-c0ac7211eb89 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:42.637182 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e6b484a4-6dbc-4d78-96b0-c0ac7211eb89 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:42.637888 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e6b484a4-6dbc-4d78-96b0-c0ac7211eb89 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:42.638343 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e6b484a4-6dbc-4d78-96b0-c0ac7211eb89 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:42.638770 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e6b484a4-6dbc-4d78-96b0-c0ac7211eb89 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:42.778447 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e6b484a4-6dbc-4d78-96b0-c0ac7211eb89 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:42.787312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e6b484a4-6dbc-4d78-96b0-c0ac7211eb89 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.161440 Aug 04 22:25:42.787890 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 321/635] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:42 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:43.576486 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-03aa140c-0f81-4f3e-8776-9c805b38579a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:43.577041 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-03aa140c-0f81-4f3e-8776-9c805b38579a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:43.583907 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03aa140c-0f81-4f3e-8776-9c805b38579a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:43.584392 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03aa140c-0f81-4f3e-8776-9c805b38579a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:43.584821 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03aa140c-0f81-4f3e-8776-9c805b38579a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:43.585689 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03aa140c-0f81-4f3e-8776-9c805b38579a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:43.586143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03aa140c-0f81-4f3e-8776-9c805b38579a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:43.586566 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03aa140c-0f81-4f3e-8776-9c805b38579a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:43.718781 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-03aa140c-0f81-4f3e-8776-9c805b38579a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:43.727782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-03aa140c-0f81-4f3e-8776-9c805b38579a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:43.729287 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-03aa140c-0f81-4f3e-8776-9c805b38579a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:43.730466 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-03aa140c-0f81-4f3e-8776-9c805b38579a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.157994 Aug 04 22:25:43.731024 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 315/636] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:43 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:43.807601 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b6d5472c-23c4-47f9-9c54-87378b6ffd49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:43.808215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b6d5472c-23c4-47f9-9c54-87378b6ffd49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:43.814361 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6d5472c-23c4-47f9-9c54-87378b6ffd49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:43.814852 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6d5472c-23c4-47f9-9c54-87378b6ffd49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:43.815307 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6d5472c-23c4-47f9-9c54-87378b6ffd49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:43.815991 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6d5472c-23c4-47f9-9c54-87378b6ffd49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:43.816448 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6d5472c-23c4-47f9-9c54-87378b6ffd49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:43.816877 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b6d5472c-23c4-47f9-9c54-87378b6ffd49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:43.948325 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b6d5472c-23c4-47f9-9c54-87378b6ffd49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:43.955957 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b6d5472c-23c4-47f9-9c54-87378b6ffd49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.152264 Aug 04 22:25:43.956514 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 322/637] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:43 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:44.754579 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4c7d8a11-9fa1-4c90-bcbc-d6972b2ea3ad tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:44.755227 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4c7d8a11-9fa1-4c90-bcbc-d6972b2ea3ad tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:44.761692 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c7d8a11-9fa1-4c90-bcbc-d6972b2ea3ad tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:44.762177 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c7d8a11-9fa1-4c90-bcbc-d6972b2ea3ad tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:44.762617 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c7d8a11-9fa1-4c90-bcbc-d6972b2ea3ad tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:44.763308 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c7d8a11-9fa1-4c90-bcbc-d6972b2ea3ad tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:44.763761 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c7d8a11-9fa1-4c90-bcbc-d6972b2ea3ad tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:44.764188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4c7d8a11-9fa1-4c90-bcbc-d6972b2ea3ad tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:44.890932 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4c7d8a11-9fa1-4c90-bcbc-d6972b2ea3ad tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:44.898940 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4c7d8a11-9fa1-4c90-bcbc-d6972b2ea3ad tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:44.900448 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4c7d8a11-9fa1-4c90-bcbc-d6972b2ea3ad tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:44.901645 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4c7d8a11-9fa1-4c90-bcbc-d6972b2ea3ad tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.151606 Aug 04 22:25:44.902202 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 316/638] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:44 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:44.975797 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-198d85b8-dade-4889-9b14-c022a5cd2bdf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:44.976417 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-198d85b8-dade-4889-9b14-c022a5cd2bdf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:44.982305 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-198d85b8-dade-4889-9b14-c022a5cd2bdf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:44.982800 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-198d85b8-dade-4889-9b14-c022a5cd2bdf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:44.983258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-198d85b8-dade-4889-9b14-c022a5cd2bdf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:44.983934 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-198d85b8-dade-4889-9b14-c022a5cd2bdf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:44.984394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-198d85b8-dade-4889-9b14-c022a5cd2bdf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:44.985507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-198d85b8-dade-4889-9b14-c022a5cd2bdf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:45.112537 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-198d85b8-dade-4889-9b14-c022a5cd2bdf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:45.120094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-198d85b8-dade-4889-9b14-c022a5cd2bdf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.148028 Aug 04 22:25:45.120659 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 323/639] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:44 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:45.924547 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-98406b25-c19c-4111-ad2f-6190175cad3d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:45.925160 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-98406b25-c19c-4111-ad2f-6190175cad3d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:45.931836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98406b25-c19c-4111-ad2f-6190175cad3d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:45.932322 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98406b25-c19c-4111-ad2f-6190175cad3d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:45.932759 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98406b25-c19c-4111-ad2f-6190175cad3d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:45.933598 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98406b25-c19c-4111-ad2f-6190175cad3d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:45.934431 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98406b25-c19c-4111-ad2f-6190175cad3d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:45.935080 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98406b25-c19c-4111-ad2f-6190175cad3d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:46.072214 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-98406b25-c19c-4111-ad2f-6190175cad3d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:46.081096 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-98406b25-c19c-4111-ad2f-6190175cad3d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:46.082709 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-98406b25-c19c-4111-ad2f-6190175cad3d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:46.084568 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-98406b25-c19c-4111-ad2f-6190175cad3d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.163930 Aug 04 22:25:46.085113 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 317/640] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:45 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:46.141880 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7ad8de64-4caa-49d2-a29e-765eac8b3b3e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:46.142500 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7ad8de64-4caa-49d2-a29e-765eac8b3b3e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:46.148798 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7ad8de64-4caa-49d2-a29e-765eac8b3b3e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:46.149532 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7ad8de64-4caa-49d2-a29e-765eac8b3b3e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:46.149972 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7ad8de64-4caa-49d2-a29e-765eac8b3b3e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:46.150681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7ad8de64-4caa-49d2-a29e-765eac8b3b3e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:46.151139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7ad8de64-4caa-49d2-a29e-765eac8b3b3e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:46.151567 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7ad8de64-4caa-49d2-a29e-765eac8b3b3e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:46.168459 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=100 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:46.293479 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7ad8de64-4caa-49d2-a29e-765eac8b3b3e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:46.300986 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7ad8de64-4caa-49d2-a29e-765eac8b3b3e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.163467 Aug 04 22:25:46.301600 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 324/641] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:46 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:47.115722 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-12f962b2-bc32-44d0-b4b3-9716b9158919 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:47.116339 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-12f962b2-bc32-44d0-b4b3-9716b9158919 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:47.123087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-12f962b2-bc32-44d0-b4b3-9716b9158919 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:47.123573 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-12f962b2-bc32-44d0-b4b3-9716b9158919 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:47.124009 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-12f962b2-bc32-44d0-b4b3-9716b9158919 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:47.124703 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-12f962b2-bc32-44d0-b4b3-9716b9158919 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:47.125162 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-12f962b2-bc32-44d0-b4b3-9716b9158919 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:47.125759 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-12f962b2-bc32-44d0-b4b3-9716b9158919 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:47.254703 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-12f962b2-bc32-44d0-b4b3-9716b9158919 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:47.262514 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-12f962b2-bc32-44d0-b4b3-9716b9158919 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:47.264338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-12f962b2-bc32-44d0-b4b3-9716b9158919 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:47.265500 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-12f962b2-bc32-44d0-b4b3-9716b9158919 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1726 microversion: 2.20 time: 0.154246 Aug 04 22:25:47.266560 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 318/642] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:47 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:47.322705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f1fc5eae-50f4-4c2e-9c7c-5374c47e7535 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:47.323325 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f1fc5eae-50f4-4c2e-9c7c-5374c47e7535 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:47.329983 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f1fc5eae-50f4-4c2e-9c7c-5374c47e7535 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:47.330476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f1fc5eae-50f4-4c2e-9c7c-5374c47e7535 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:47.330919 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f1fc5eae-50f4-4c2e-9c7c-5374c47e7535 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:47.331612 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f1fc5eae-50f4-4c2e-9c7c-5374c47e7535 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:47.332070 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f1fc5eae-50f4-4c2e-9c7c-5374c47e7535 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:47.332496 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f1fc5eae-50f4-4c2e-9c7c-5374c47e7535 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:47.471763 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f1fc5eae-50f4-4c2e-9c7c-5374c47e7535 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:47.479405 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f1fc5eae-50f4-4c2e-9c7c-5374c47e7535 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.160482 Aug 04 22:25:47.479969 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 325/643] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:47 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:48.288980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-25c1485e-1733-455c-9c58-618a7b3b0555 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:48.289615 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-25c1485e-1733-455c-9c58-618a7b3b0555 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:48.296019 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25c1485e-1733-455c-9c58-618a7b3b0555 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:48.296438 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25c1485e-1733-455c-9c58-618a7b3b0555 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:48.296868 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25c1485e-1733-455c-9c58-618a7b3b0555 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:48.298321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25c1485e-1733-455c-9c58-618a7b3b0555 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:48.298713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25c1485e-1733-455c-9c58-618a7b3b0555 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:48.299134 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25c1485e-1733-455c-9c58-618a7b3b0555 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:48.428947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-25c1485e-1733-455c-9c58-618a7b3b0555 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:48.438913 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-25c1485e-1733-455c-9c58-618a7b3b0555 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:48.440580 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-25c1485e-1733-455c-9c58-618a7b3b0555 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:48.442000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-25c1485e-1733-455c-9c58-618a7b3b0555 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1729 microversion: 2.20 time: 0.156947 Aug 04 22:25:48.447058 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 319/644] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:48 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:48.464600 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d4345fbb-8355-47a9-975c-5a3f6692b476 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75b2d564-c119-45e5-b893-c3db69ca45d5"}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:25:48.467145 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d4345fbb-8355-47a9-975c-5a3f6692b476 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:48.474394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4345fbb-8355-47a9-975c-5a3f6692b476 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:48.475208 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4345fbb-8355-47a9-975c-5a3f6692b476 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:48.475754 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4345fbb-8355-47a9-975c-5a3f6692b476 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:48.476561 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4345fbb-8355-47a9-975c-5a3f6692b476 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:48.477751 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4345fbb-8355-47a9-975c-5a3f6692b476 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:48.478295 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4345fbb-8355-47a9-975c-5a3f6692b476 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:48.500237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-139c9dca-6f75-4c17-ab2d-e67e3b8e15ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:48.501179 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-139c9dca-6f75-4c17-ab2d-e67e3b8e15ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:48.507362 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-139c9dca-6f75-4c17-ab2d-e67e3b8e15ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:48.507897 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-139c9dca-6f75-4c17-ab2d-e67e3b8e15ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:48.508330 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-139c9dca-6f75-4c17-ab2d-e67e3b8e15ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:48.509232 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-139c9dca-6f75-4c17-ab2d-e67e3b8e15ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:48.509499 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-139c9dca-6f75-4c17-ab2d-e67e3b8e15ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:48.509926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-139c9dca-6f75-4c17-ab2d-e67e3b8e15ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:48.528413 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:48.659917 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-139c9dca-6f75-4c17-ab2d-e67e3b8e15ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:48.667457 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-139c9dca-6f75-4c17-ab2d-e67e3b8e15ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.171133 Aug 04 22:25:48.667999 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 320/645] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:48 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:25:48.807985 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d4345fbb-8355-47a9-975c-5a3f6692b476 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "POST /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.347475 Aug 04 22:25:48.808624 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 326/646] 10.222.0.109 () {62 vars in 1369 bytes} [Thu Aug 4 22:25:48 2022] POST /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-volume_attachments => generated 188 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:25:48.931661 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-593ef921-8218-49a1-845b-9067f1037b4f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:25:48.932295 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-593ef921-8218-49a1-845b-9067f1037b4f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:48.938408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-593ef921-8218-49a1-845b-9067f1037b4f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:48.938886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-593ef921-8218-49a1-845b-9067f1037b4f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:48.939318 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-593ef921-8218-49a1-845b-9067f1037b4f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:48.940000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-593ef921-8218-49a1-845b-9067f1037b4f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:48.940452 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-593ef921-8218-49a1-845b-9067f1037b4f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:48.940869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-593ef921-8218-49a1-845b-9067f1037b4f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:49.026413 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-593ef921-8218-49a1-845b-9067f1037b4f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129196) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 22:25:49.093057 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-593ef921-8218-49a1-845b-9067f1037b4f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "POST /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/action" status: 202 len: 0 microversion: 2.20 time: 0.165307 Aug 04 22:25:49.096952 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 321/647] 10.222.0.109 () {62 vars in 1324 bytes} [Thu Aug 4 22:25:48 2022] POST /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:25:49.103350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e76c0719-3dea-4813-aaae-49b391ad166d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:49.103350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e76c0719-3dea-4813-aaae-49b391ad166d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:49.109739 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e76c0719-3dea-4813-aaae-49b391ad166d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:49.110328 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e76c0719-3dea-4813-aaae-49b391ad166d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:49.110764 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e76c0719-3dea-4813-aaae-49b391ad166d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:49.111833 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e76c0719-3dea-4813-aaae-49b391ad166d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:49.112185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e76c0719-3dea-4813-aaae-49b391ad166d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:49.112605 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e76c0719-3dea-4813-aaae-49b391ad166d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:49.253682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e76c0719-3dea-4813-aaae-49b391ad166d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:49.262365 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e76c0719-3dea-4813-aaae-49b391ad166d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:49.263855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e76c0719-3dea-4813-aaae-49b391ad166d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:49.264999 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e76c0719-3dea-4813-aaae-49b391ad166d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1755 microversion: 2.20 time: 0.166564 Aug 04 22:25:49.265586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 327/648] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:49 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:49.689015 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1ff09199-049c-4012-983a-aa60798899b7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:49.689698 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1ff09199-049c-4012-983a-aa60798899b7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:49.695804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1ff09199-049c-4012-983a-aa60798899b7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:49.696291 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1ff09199-049c-4012-983a-aa60798899b7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:49.696757 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1ff09199-049c-4012-983a-aa60798899b7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:49.697700 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1ff09199-049c-4012-983a-aa60798899b7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:49.698160 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1ff09199-049c-4012-983a-aa60798899b7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:49.698585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1ff09199-049c-4012-983a-aa60798899b7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:49.841936 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1ff09199-049c-4012-983a-aa60798899b7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:49.851507 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1ff09199-049c-4012-983a-aa60798899b7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.167796 Aug 04 22:25:49.852268 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 322/649] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:49 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:49.867821 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-c12b05dc-792b-43a7-a553-c772247c6f2a req-f8097d6f-abd1-41cd-8184-5b1976c0121a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b377be43-9cb6-4bf2-9702-a280d8cc51b9", "name": "network-vif-plugged", "status": "completed", "tag": "74713ddd-d0bb-4812-8557-156b3e19e333"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:25:49.879736 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c12b05dc-792b-43a7-a553-c772247c6f2a req-f8097d6f-abd1-41cd-8184-5b1976c0121a service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:49.880298 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c12b05dc-792b-43a7-a553-c772247c6f2a req-f8097d6f-abd1-41cd-8184-5b1976c0121a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:49.880793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c12b05dc-792b-43a7-a553-c772247c6f2a req-f8097d6f-abd1-41cd-8184-5b1976c0121a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:49.893244 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-c12b05dc-792b-43a7-a553-c772247c6f2a req-f8097d6f-abd1-41cd-8184-5b1976c0121a service nova] Creating event network-vif-plugged:74713ddd-d0bb-4812-8557-156b3e19e333 for instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 on hv-cinder-85221 Aug 04 22:25:49.899192 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-c12b05dc-792b-43a7-a553-c772247c6f2a req-f8097d6f-abd1-41cd-8184-5b1976c0121a service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035619 Aug 04 22:25:49.900993 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 328/650] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:25:50.287946 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b058b0e3-24d6-43ed-ab87-67b5714ce322 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:50.288741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b058b0e3-24d6-43ed-ab87-67b5714ce322 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:50.295236 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b058b0e3-24d6-43ed-ab87-67b5714ce322 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:50.295744 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b058b0e3-24d6-43ed-ab87-67b5714ce322 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:50.296180 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b058b0e3-24d6-43ed-ab87-67b5714ce322 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:50.297436 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b058b0e3-24d6-43ed-ab87-67b5714ce322 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:50.298179 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b058b0e3-24d6-43ed-ab87-67b5714ce322 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:50.298648 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b058b0e3-24d6-43ed-ab87-67b5714ce322 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:50.428001 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b058b0e3-24d6-43ed-ab87-67b5714ce322 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:50.436405 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b058b0e3-24d6-43ed-ab87-67b5714ce322 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:50.438030 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b058b0e3-24d6-43ed-ab87-67b5714ce322 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:50.439261 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b058b0e3-24d6-43ed-ab87-67b5714ce322 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1757 microversion: 2.20 time: 0.155349 Aug 04 22:25:50.439818 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 323/651] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:50 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1757 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:50.874832 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-834daf02-ffc3-40c6-bc83-550332026abc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:50.875834 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-834daf02-ffc3-40c6-bc83-550332026abc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:50.881889 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-834daf02-ffc3-40c6-bc83-550332026abc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:50.882377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-834daf02-ffc3-40c6-bc83-550332026abc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:50.882817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-834daf02-ffc3-40c6-bc83-550332026abc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:50.883508 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-834daf02-ffc3-40c6-bc83-550332026abc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:50.883968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-834daf02-ffc3-40c6-bc83-550332026abc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:50.884400 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-834daf02-ffc3-40c6-bc83-550332026abc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:51.022840 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-834daf02-ffc3-40c6-bc83-550332026abc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:51.031401 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-834daf02-ffc3-40c6-bc83-550332026abc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.160702 Aug 04 22:25:51.032743 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 329/652] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:50 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:51.466306 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-05859806-b6af-405f-86a6-0b5b9d96cc58 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:51.467056 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-05859806-b6af-405f-86a6-0b5b9d96cc58 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:51.473866 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-05859806-b6af-405f-86a6-0b5b9d96cc58 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:51.474355 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-05859806-b6af-405f-86a6-0b5b9d96cc58 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:51.474794 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-05859806-b6af-405f-86a6-0b5b9d96cc58 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:51.475500 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-05859806-b6af-405f-86a6-0b5b9d96cc58 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:51.475958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-05859806-b6af-405f-86a6-0b5b9d96cc58 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:51.476386 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-05859806-b6af-405f-86a6-0b5b9d96cc58 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:51.611426 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-05859806-b6af-405f-86a6-0b5b9d96cc58 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:51.619863 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-05859806-b6af-405f-86a6-0b5b9d96cc58 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:51.621386 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-05859806-b6af-405f-86a6-0b5b9d96cc58 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:51.622572 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-05859806-b6af-405f-86a6-0b5b9d96cc58 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1757 microversion: 2.20 time: 0.161789 Aug 04 22:25:51.623144 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 324/653] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:51 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:52.054178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-26d1bc3a-b2b8-4dde-97d3-ce28f5629018 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:52.054724 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-26d1bc3a-b2b8-4dde-97d3-ce28f5629018 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:52.060624 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26d1bc3a-b2b8-4dde-97d3-ce28f5629018 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:52.061109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26d1bc3a-b2b8-4dde-97d3-ce28f5629018 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:52.061609 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26d1bc3a-b2b8-4dde-97d3-ce28f5629018 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:52.062326 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26d1bc3a-b2b8-4dde-97d3-ce28f5629018 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:52.062810 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26d1bc3a-b2b8-4dde-97d3-ce28f5629018 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:52.063236 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26d1bc3a-b2b8-4dde-97d3-ce28f5629018 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:52.196679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-26d1bc3a-b2b8-4dde-97d3-ce28f5629018 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:52.206144 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-26d1bc3a-b2b8-4dde-97d3-ce28f5629018 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1372 microversion: 2.1 time: 0.155874 Aug 04 22:25:52.206732 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 330/654] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:52 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:52.435402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-795567e6-b053-413d-b7e8-db3b3a7947ac tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:52.435892 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-795567e6-b053-413d-b7e8-db3b3a7947ac tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:52.442727 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-795567e6-b053-413d-b7e8-db3b3a7947ac tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:52.443202 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-795567e6-b053-413d-b7e8-db3b3a7947ac tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:52.443631 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-795567e6-b053-413d-b7e8-db3b3a7947ac tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:52.444308 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-795567e6-b053-413d-b7e8-db3b3a7947ac tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:52.444754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-795567e6-b053-413d-b7e8-db3b3a7947ac tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:52.445380 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-795567e6-b053-413d-b7e8-db3b3a7947ac tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:52.571777 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-795567e6-b053-413d-b7e8-db3b3a7947ac tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lazy-loading 'services' on Instance uuid 9e3daf69-e689-453d-81d4-9eba29e8f352 {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:25:52.646970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ec9e7224-a062-4864-b0a1-7ef8e72adb0f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:52.647765 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ec9e7224-a062-4864-b0a1-7ef8e72adb0f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:52.653654 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ec9e7224-a062-4864-b0a1-7ef8e72adb0f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:52.654145 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ec9e7224-a062-4864-b0a1-7ef8e72adb0f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:52.654582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ec9e7224-a062-4864-b0a1-7ef8e72adb0f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:52.655284 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ec9e7224-a062-4864-b0a1-7ef8e72adb0f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:52.655739 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ec9e7224-a062-4864-b0a1-7ef8e72adb0f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:52.656905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ec9e7224-a062-4864-b0a1-7ef8e72adb0f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:52.689451 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-795567e6-b053-413d-b7e8-db3b3a7947ac tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "DELETE /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352/os-volume_attachments/50b38f3f-b8a9-4dd4-99f3-14d396cb7933" status: 202 len: 0 microversion: 2.1 time: 0.257833 Aug 04 22:25:52.690053 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 325/655] 10.222.0.109 () {58 vars in 1421 bytes} [Thu Aug 4 22:25:52 2022] DELETE /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352/os-volume_attachments/50b38f3f-b8a9-4dd4-99f3-14d396cb7933 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:25:52.803174 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ec9e7224-a062-4864-b0a1-7ef8e72adb0f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:52.811604 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ec9e7224-a062-4864-b0a1-7ef8e72adb0f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:52.813739 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ec9e7224-a062-4864-b0a1-7ef8e72adb0f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:52.815023 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ec9e7224-a062-4864-b0a1-7ef8e72adb0f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.171965 Aug 04 22:25:52.815585 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 331/656] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:52 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:25:53.230192 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-18489992-d876-481a-816c-20f12bb1710e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:53.230894 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-18489992-d876-481a-816c-20f12bb1710e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:53.237900 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-18489992-d876-481a-816c-20f12bb1710e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:53.238388 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-18489992-d876-481a-816c-20f12bb1710e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:53.238825 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-18489992-d876-481a-816c-20f12bb1710e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:53.239518 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-18489992-d876-481a-816c-20f12bb1710e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:53.239975 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-18489992-d876-481a-816c-20f12bb1710e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:53.240400 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-18489992-d876-481a-816c-20f12bb1710e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:53.369505 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-18489992-d876-481a-816c-20f12bb1710e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:53.377702 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-18489992-d876-481a-816c-20f12bb1710e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1562 microversion: 2.1 time: 0.152407 Aug 04 22:25:53.378272 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 326/657] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:53 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:53.398006 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-eace7c57-b74a-4e91-8ea8-11cf46761a6a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:53.398601 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-eace7c57-b74a-4e91-8ea8-11cf46761a6a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:53.400629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=60 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:53.405782 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eace7c57-b74a-4e91-8ea8-11cf46761a6a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:53.406258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eace7c57-b74a-4e91-8ea8-11cf46761a6a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:53.406688 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eace7c57-b74a-4e91-8ea8-11cf46761a6a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:53.407367 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eace7c57-b74a-4e91-8ea8-11cf46761a6a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:53.408001 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eace7c57-b74a-4e91-8ea8-11cf46761a6a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:53.408556 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eace7c57-b74a-4e91-8ea8-11cf46761a6a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:53.485501 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-eace7c57-b74a-4e91-8ea8-11cf46761a6a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091495 Aug 04 22:25:53.486694 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 332/658] 10.222.0.109 () {58 vars in 1280 bytes} [Thu Aug 4 22:25:53 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:25:53.839015 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5005e4ad-0be3-401f-a3d0-fa53e44f0922 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:53.839625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5005e4ad-0be3-401f-a3d0-fa53e44f0922 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:53.846924 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5005e4ad-0be3-401f-a3d0-fa53e44f0922 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:53.847407 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5005e4ad-0be3-401f-a3d0-fa53e44f0922 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:53.847842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5005e4ad-0be3-401f-a3d0-fa53e44f0922 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:53.848544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5005e4ad-0be3-401f-a3d0-fa53e44f0922 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:53.849002 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5005e4ad-0be3-401f-a3d0-fa53e44f0922 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:53.849444 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5005e4ad-0be3-401f-a3d0-fa53e44f0922 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:53.992164 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5005e4ad-0be3-401f-a3d0-fa53e44f0922 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:54.002520 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5005e4ad-0be3-401f-a3d0-fa53e44f0922 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:54.004025 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5005e4ad-0be3-401f-a3d0-fa53e44f0922 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:54.005188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5005e4ad-0be3-401f-a3d0-fa53e44f0922 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.170066 Aug 04 22:25:54.005777 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 327/659] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:53 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:25:54.879660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f22b0900-cfbe-4a5e-bf8a-c6c30b7189fd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:54.880166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f22b0900-cfbe-4a5e-bf8a-c6c30b7189fd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:54.886213 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f22b0900-cfbe-4a5e-bf8a-c6c30b7189fd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:54.886707 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f22b0900-cfbe-4a5e-bf8a-c6c30b7189fd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:54.887173 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f22b0900-cfbe-4a5e-bf8a-c6c30b7189fd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:54.887875 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f22b0900-cfbe-4a5e-bf8a-c6c30b7189fd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:54.888334 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f22b0900-cfbe-4a5e-bf8a-c6c30b7189fd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:54.888762 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f22b0900-cfbe-4a5e-bf8a-c6c30b7189fd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:54.913613 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f22b0900-cfbe-4a5e-bf8a-c6c30b7189fd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Going to try to terminate instance {{(pid=129197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:25:54.991958 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f22b0900-cfbe-4a5e-bf8a-c6c30b7189fd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "DELETE /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 204 len: 0 microversion: 2.1 time: 0.116456 Aug 04 22:25:54.992558 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 333/660] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:25:54 2022] DELETE /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:25:55.002244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7708521b-e3ee-4eae-86c0-6be970f092ae tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:55.003506 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7708521b-e3ee-4eae-86c0-6be970f092ae tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:55.013161 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7708521b-e3ee-4eae-86c0-6be970f092ae tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:55.014078 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7708521b-e3ee-4eae-86c0-6be970f092ae tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:55.014948 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7708521b-e3ee-4eae-86c0-6be970f092ae tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:55.015924 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7708521b-e3ee-4eae-86c0-6be970f092ae tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:55.016725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7708521b-e3ee-4eae-86c0-6be970f092ae tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:55.017625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7708521b-e3ee-4eae-86c0-6be970f092ae tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:55.034608 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-53ef4290-870e-431a-9afa-606405fb4d9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:55.036483 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-53ef4290-870e-431a-9afa-606405fb4d9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:55.046043 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-53ef4290-870e-431a-9afa-606405fb4d9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:55.046793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-53ef4290-870e-431a-9afa-606405fb4d9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:55.047392 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-53ef4290-870e-431a-9afa-606405fb4d9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:55.049201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-53ef4290-870e-431a-9afa-606405fb4d9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:55.049829 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-53ef4290-870e-431a-9afa-606405fb4d9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:55.050892 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-53ef4290-870e-431a-9afa-606405fb4d9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:55.191156 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7708521b-e3ee-4eae-86c0-6be970f092ae tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:55.198741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7708521b-e3ee-4eae-86c0-6be970f092ae tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.201874 Aug 04 22:25:55.208921 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 328/661] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:54 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:55.232009 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-53ef4290-870e-431a-9afa-606405fb4d9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:55.241153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-53ef4290-870e-431a-9afa-606405fb4d9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:55.242864 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-53ef4290-870e-431a-9afa-606405fb4d9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:55.244089 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-53ef4290-870e-431a-9afa-606405fb4d9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.218595 Aug 04 22:25:55.244817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 334/662] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:55 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:25:55.274004 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-fc0eff65-56bb-4575-9467-c9332bbb0da0 req-70977f40-0777-4cfb-ac71-4f2b8cd658aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b377be43-9cb6-4bf2-9702-a280d8cc51b9", "tag": "74713ddd-d0bb-4812-8557-156b3e19e333"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:25:55.283503 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-fc0eff65-56bb-4575-9467-c9332bbb0da0 req-70977f40-0777-4cfb-ac71-4f2b8cd658aa service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:55.283990 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-fc0eff65-56bb-4575-9467-c9332bbb0da0 req-70977f40-0777-4cfb-ac71-4f2b8cd658aa service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:55.284420 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-fc0eff65-56bb-4575-9467-c9332bbb0da0 req-70977f40-0777-4cfb-ac71-4f2b8cd658aa service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:55.295122 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-fc0eff65-56bb-4575-9467-c9332bbb0da0 req-70977f40-0777-4cfb-ac71-4f2b8cd658aa service nova] Creating event network-changed:74713ddd-d0bb-4812-8557-156b3e19e333 for instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 on hv-cinder-85221 Aug 04 22:25:55.301014 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-fc0eff65-56bb-4575-9467-c9332bbb0da0 req-70977f40-0777-4cfb-ac71-4f2b8cd658aa service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100595 Aug 04 22:25:55.301641 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 329/663] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:25:56.222817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-fcc588c0-3df7-46c5-bc3a-83525a4b973c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:56.223433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-fcc588c0-3df7-46c5-bc3a-83525a4b973c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:56.229379 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fcc588c0-3df7-46c5-bc3a-83525a4b973c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:56.229889 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fcc588c0-3df7-46c5-bc3a-83525a4b973c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:56.230317 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fcc588c0-3df7-46c5-bc3a-83525a4b973c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:56.231000 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fcc588c0-3df7-46c5-bc3a-83525a4b973c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:56.231447 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fcc588c0-3df7-46c5-bc3a-83525a4b973c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:56.231876 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fcc588c0-3df7-46c5-bc3a-83525a4b973c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:56.268236 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b93db959-89e4-4b16-8d8b-eac6b96f924d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:56.269010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b93db959-89e4-4b16-8d8b-eac6b96f924d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:56.276013 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b93db959-89e4-4b16-8d8b-eac6b96f924d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:56.276580 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b93db959-89e4-4b16-8d8b-eac6b96f924d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:56.277093 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b93db959-89e4-4b16-8d8b-eac6b96f924d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:56.277895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b93db959-89e4-4b16-8d8b-eac6b96f924d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:56.278423 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b93db959-89e4-4b16-8d8b-eac6b96f924d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:56.278943 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b93db959-89e4-4b16-8d8b-eac6b96f924d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:56.370228 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-fcc588c0-3df7-46c5-bc3a-83525a4b973c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:56.378028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-fcc588c0-3df7-46c5-bc3a-83525a4b973c tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.159330 Aug 04 22:25:56.378603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 335/664] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:56 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:56.423043 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b93db959-89e4-4b16-8d8b-eac6b96f924d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:56.431856 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b93db959-89e4-4b16-8d8b-eac6b96f924d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:56.433434 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b93db959-89e4-4b16-8d8b-eac6b96f924d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:56.434581 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b93db959-89e4-4b16-8d8b-eac6b96f924d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.171190 Aug 04 22:25:56.435142 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 330/665] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:56 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:25:57.399209 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-391a16fe-096a-48dd-958d-d158790a6d90 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:57.399796 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-391a16fe-096a-48dd-958d-d158790a6d90 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:57.406353 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-391a16fe-096a-48dd-958d-d158790a6d90 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:57.406835 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-391a16fe-096a-48dd-958d-d158790a6d90 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:57.407657 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-391a16fe-096a-48dd-958d-d158790a6d90 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:57.408365 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-391a16fe-096a-48dd-958d-d158790a6d90 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:57.408811 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-391a16fe-096a-48dd-958d-d158790a6d90 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:57.409230 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-391a16fe-096a-48dd-958d-d158790a6d90 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:57.460067 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-62fc0b19-3886-47c0-b35e-48ea27648bbd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:57.461442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-62fc0b19-3886-47c0-b35e-48ea27648bbd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:57.470697 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-62fc0b19-3886-47c0-b35e-48ea27648bbd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:57.471368 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-62fc0b19-3886-47c0-b35e-48ea27648bbd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:57.472177 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-62fc0b19-3886-47c0-b35e-48ea27648bbd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:57.472998 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-62fc0b19-3886-47c0-b35e-48ea27648bbd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:57.473529 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-62fc0b19-3886-47c0-b35e-48ea27648bbd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:57.474034 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-62fc0b19-3886-47c0-b35e-48ea27648bbd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:57.577346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-391a16fe-096a-48dd-958d-d158790a6d90 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:57.585543 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-391a16fe-096a-48dd-958d-d158790a6d90 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.190066 Aug 04 22:25:57.586147 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 336/666] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:57 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:57.642686 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-62fc0b19-3886-47c0-b35e-48ea27648bbd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:57.651489 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-62fc0b19-3886-47c0-b35e-48ea27648bbd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:57.652922 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-62fc0b19-3886-47c0-b35e-48ea27648bbd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:57.654112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-62fc0b19-3886-47c0-b35e-48ea27648bbd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.198355 Aug 04 22:25:57.655053 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 331/667] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:57 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:25:58.607934 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-58bfdadf-050a-4e70-be03-f357366a2cff tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:58.608550 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-58bfdadf-050a-4e70-be03-f357366a2cff tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:58.615105 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58bfdadf-050a-4e70-be03-f357366a2cff tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:58.615583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58bfdadf-050a-4e70-be03-f357366a2cff tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:58.616011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58bfdadf-050a-4e70-be03-f357366a2cff tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:58.616699 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58bfdadf-050a-4e70-be03-f357366a2cff tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:58.617149 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58bfdadf-050a-4e70-be03-f357366a2cff tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:58.617606 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58bfdadf-050a-4e70-be03-f357366a2cff tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:58.678097 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3081cff0-7bed-408a-9319-eb0627e7b689 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:58.678841 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3081cff0-7bed-408a-9319-eb0627e7b689 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:58.685982 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3081cff0-7bed-408a-9319-eb0627e7b689 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:58.686461 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3081cff0-7bed-408a-9319-eb0627e7b689 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:58.686891 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3081cff0-7bed-408a-9319-eb0627e7b689 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:58.687582 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3081cff0-7bed-408a-9319-eb0627e7b689 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:58.688028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3081cff0-7bed-408a-9319-eb0627e7b689 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:58.688971 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3081cff0-7bed-408a-9319-eb0627e7b689 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:58.775460 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-58bfdadf-050a-4e70-be03-f357366a2cff tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:58.777803 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:58.784675 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-58bfdadf-050a-4e70-be03-f357366a2cff tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.180519 Aug 04 22:25:58.785256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 337/668] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:58 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:25:58.832490 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3081cff0-7bed-408a-9319-eb0627e7b689 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:58.840963 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3081cff0-7bed-408a-9319-eb0627e7b689 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:58.842489 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3081cff0-7bed-408a-9319-eb0627e7b689 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:58.843645 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3081cff0-7bed-408a-9319-eb0627e7b689 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.169434 Aug 04 22:25:58.844364 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 332/669] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:58 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:25:59.806412 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2c0f7692-c0a0-4add-a6e8-63bcac3b848b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:59.807027 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2c0f7692-c0a0-4add-a6e8-63bcac3b848b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:59.814302 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2c0f7692-c0a0-4add-a6e8-63bcac3b848b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:59.814779 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2c0f7692-c0a0-4add-a6e8-63bcac3b848b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:59.815744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2c0f7692-c0a0-4add-a6e8-63bcac3b848b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:59.816380 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2c0f7692-c0a0-4add-a6e8-63bcac3b848b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:59.816826 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2c0f7692-c0a0-4add-a6e8-63bcac3b848b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:59.817242 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2c0f7692-c0a0-4add-a6e8-63bcac3b848b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:59.867504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-29d038fc-0d7c-42cc-8107-dfba9c13637c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:25:59.868115 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-29d038fc-0d7c-42cc-8107-dfba9c13637c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:25:59.875076 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-29d038fc-0d7c-42cc-8107-dfba9c13637c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:59.875594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-29d038fc-0d7c-42cc-8107-dfba9c13637c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:59.876032 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-29d038fc-0d7c-42cc-8107-dfba9c13637c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:59.876973 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-29d038fc-0d7c-42cc-8107-dfba9c13637c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:25:59.878120 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-29d038fc-0d7c-42cc-8107-dfba9c13637c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:25:59.878585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-29d038fc-0d7c-42cc-8107-dfba9c13637c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:25:59.976816 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2c0f7692-c0a0-4add-a6e8-63bcac3b848b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:25:59.984758 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2c0f7692-c0a0-4add-a6e8-63bcac3b848b tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.182101 Aug 04 22:25:59.985343 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 338/670] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:25:59 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:26:00.036737 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-29d038fc-0d7c-42cc-8107-dfba9c13637c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:00.046498 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-29d038fc-0d7c-42cc-8107-dfba9c13637c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:00.048262 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-29d038fc-0d7c-42cc-8107-dfba9c13637c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:00.049983 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-29d038fc-0d7c-42cc-8107-dfba9c13637c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.186547 Aug 04 22:26:00.051393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 333/671] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:25:59 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:26:01.006260 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-229165f6-6854-4a0b-8154-5ca2d644e712 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:01.006966 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-229165f6-6854-4a0b-8154-5ca2d644e712 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:01.013728 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-229165f6-6854-4a0b-8154-5ca2d644e712 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:01.014221 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-229165f6-6854-4a0b-8154-5ca2d644e712 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:01.014658 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-229165f6-6854-4a0b-8154-5ca2d644e712 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:01.015572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-229165f6-6854-4a0b-8154-5ca2d644e712 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:01.016032 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-229165f6-6854-4a0b-8154-5ca2d644e712 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:01.016500 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-229165f6-6854-4a0b-8154-5ca2d644e712 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:01.074607 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7551f3ea-37de-4bf0-9408-21259ef9bf4d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:01.075656 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7551f3ea-37de-4bf0-9408-21259ef9bf4d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:01.083000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:01.085000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7551f3ea-37de-4bf0-9408-21259ef9bf4d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:01.085974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7551f3ea-37de-4bf0-9408-21259ef9bf4d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:01.086464 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7551f3ea-37de-4bf0-9408-21259ef9bf4d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:01.087483 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7551f3ea-37de-4bf0-9408-21259ef9bf4d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:01.087947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7551f3ea-37de-4bf0-9408-21259ef9bf4d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:01.088381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7551f3ea-37de-4bf0-9408-21259ef9bf4d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:01.171766 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-229165f6-6854-4a0b-8154-5ca2d644e712 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:01.180592 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-229165f6-6854-4a0b-8154-5ca2d644e712 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.178078 Aug 04 22:26:01.181170 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 339/672] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:01 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:01.243122 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7551f3ea-37de-4bf0-9408-21259ef9bf4d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:01.251849 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7551f3ea-37de-4bf0-9408-21259ef9bf4d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:01.253452 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7551f3ea-37de-4bf0-9408-21259ef9bf4d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:01.254625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7551f3ea-37de-4bf0-9408-21259ef9bf4d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.184049 Aug 04 22:26:01.258015 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 334/673] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:01 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:02.203797 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-05f6c36e-4857-4a86-8b3f-5a40e402dfa9 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:02.206635 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-05f6c36e-4857-4a86-8b3f-5a40e402dfa9 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:02.221092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-05f6c36e-4857-4a86-8b3f-5a40e402dfa9 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:02.222705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-05f6c36e-4857-4a86-8b3f-5a40e402dfa9 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:02.223668 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-05f6c36e-4857-4a86-8b3f-5a40e402dfa9 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:02.224555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-05f6c36e-4857-4a86-8b3f-5a40e402dfa9 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:02.225247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-05f6c36e-4857-4a86-8b3f-5a40e402dfa9 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:02.225765 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-05f6c36e-4857-4a86-8b3f-5a40e402dfa9 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:02.279042 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-da9fd58f-a0cf-4d05-85e6-47ee27c7ebae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:02.279674 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-da9fd58f-a0cf-4d05-85e6-47ee27c7ebae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:02.287988 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-da9fd58f-a0cf-4d05-85e6-47ee27c7ebae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:02.288579 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-da9fd58f-a0cf-4d05-85e6-47ee27c7ebae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:02.289098 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-da9fd58f-a0cf-4d05-85e6-47ee27c7ebae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:02.289915 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-da9fd58f-a0cf-4d05-85e6-47ee27c7ebae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:02.290438 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-da9fd58f-a0cf-4d05-85e6-47ee27c7ebae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:02.290932 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-da9fd58f-a0cf-4d05-85e6-47ee27c7ebae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:02.418923 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-05f6c36e-4857-4a86-8b3f-5a40e402dfa9 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:02.431710 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-05f6c36e-4857-4a86-8b3f-5a40e402dfa9 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.231722 Aug 04 22:26:02.434723 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 340/674] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:02 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:02.455146 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-da9fd58f-a0cf-4d05-85e6-47ee27c7ebae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:02.464862 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-da9fd58f-a0cf-4d05-85e6-47ee27c7ebae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:02.466408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-da9fd58f-a0cf-4d05-85e6-47ee27c7ebae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:02.467600 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-da9fd58f-a0cf-4d05-85e6-47ee27c7ebae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.192450 Aug 04 22:26:02.468410 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 335/675] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:02 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:03.455243 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1b7bd271-4d89-4aa2-a337-13172248d567 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:03.455885 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1b7bd271-4d89-4aa2-a337-13172248d567 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:03.462494 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b7bd271-4d89-4aa2-a337-13172248d567 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:03.463133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b7bd271-4d89-4aa2-a337-13172248d567 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:03.463674 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b7bd271-4d89-4aa2-a337-13172248d567 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:03.464487 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b7bd271-4d89-4aa2-a337-13172248d567 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:03.468915 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b7bd271-4d89-4aa2-a337-13172248d567 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:03.469574 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b7bd271-4d89-4aa2-a337-13172248d567 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:03.493385 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-13ba88ad-9521-4600-891d-91f065e0e181 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:03.494121 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-13ba88ad-9521-4600-891d-91f065e0e181 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:03.500467 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-13ba88ad-9521-4600-891d-91f065e0e181 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:03.501083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-13ba88ad-9521-4600-891d-91f065e0e181 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:03.501660 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-13ba88ad-9521-4600-891d-91f065e0e181 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:03.506950 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-13ba88ad-9521-4600-891d-91f065e0e181 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:03.506950 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-13ba88ad-9521-4600-891d-91f065e0e181 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:03.506950 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-13ba88ad-9521-4600-891d-91f065e0e181 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:03.509308 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:03.639028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1b7bd271-4d89-4aa2-a337-13172248d567 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:03.647927 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1b7bd271-4d89-4aa2-a337-13172248d567 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.196572 Aug 04 22:26:03.672163 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 341/676] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:03 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:03.698061 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-13ba88ad-9521-4600-891d-91f065e0e181 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:03.706614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-13ba88ad-9521-4600-891d-91f065e0e181 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:03.709185 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-13ba88ad-9521-4600-891d-91f065e0e181 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:03.710373 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-13ba88ad-9521-4600-891d-91f065e0e181 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.221430 Aug 04 22:26:03.710931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 336/677] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:03 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:26:04.675967 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-87b237f6-d12d-4b0c-ac93-9b0df342aafe tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:04.676642 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-87b237f6-d12d-4b0c-ac93-9b0df342aafe tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:04.687861 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-87b237f6-d12d-4b0c-ac93-9b0df342aafe tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:04.687861 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-87b237f6-d12d-4b0c-ac93-9b0df342aafe tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:04.687861 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-87b237f6-d12d-4b0c-ac93-9b0df342aafe tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:04.687861 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-87b237f6-d12d-4b0c-ac93-9b0df342aafe tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:04.688324 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-87b237f6-d12d-4b0c-ac93-9b0df342aafe tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:04.688324 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-87b237f6-d12d-4b0c-ac93-9b0df342aafe tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:04.736275 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6ec57905-edfa-4519-82ca-d08484028e2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:04.736900 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6ec57905-edfa-4519-82ca-d08484028e2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:04.743582 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ec57905-edfa-4519-82ca-d08484028e2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:04.744077 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ec57905-edfa-4519-82ca-d08484028e2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:04.744520 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ec57905-edfa-4519-82ca-d08484028e2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:04.745225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ec57905-edfa-4519-82ca-d08484028e2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:04.745710 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ec57905-edfa-4519-82ca-d08484028e2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:04.746217 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ec57905-edfa-4519-82ca-d08484028e2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:04.845476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-87b237f6-d12d-4b0c-ac93-9b0df342aafe tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:04.859776 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-87b237f6-d12d-4b0c-ac93-9b0df342aafe tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.187640 Aug 04 22:26:04.860373 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 342/678] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:04 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:04.910719 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6ec57905-edfa-4519-82ca-d08484028e2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:04.920582 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6ec57905-edfa-4519-82ca-d08484028e2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:04.922296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6ec57905-edfa-4519-82ca-d08484028e2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:04.923490 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6ec57905-edfa-4519-82ca-d08484028e2f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.193899 Aug 04 22:26:04.933918 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 337/679] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:04 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:05.886010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e80d1ed7-08f3-4216-956c-ab8a12451bed tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:05.886808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e80d1ed7-08f3-4216-956c-ab8a12451bed tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:05.894091 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e80d1ed7-08f3-4216-956c-ab8a12451bed tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:05.895275 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e80d1ed7-08f3-4216-956c-ab8a12451bed tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:05.895782 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e80d1ed7-08f3-4216-956c-ab8a12451bed tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:05.896571 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e80d1ed7-08f3-4216-956c-ab8a12451bed tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:05.897153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e80d1ed7-08f3-4216-956c-ab8a12451bed tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:05.897613 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e80d1ed7-08f3-4216-956c-ab8a12451bed tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:05.947728 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-03bbf21f-c5dd-4e8f-bead-df0674ab46e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:05.948430 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-03bbf21f-c5dd-4e8f-bead-df0674ab46e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:05.954904 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03bbf21f-c5dd-4e8f-bead-df0674ab46e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:05.966044 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03bbf21f-c5dd-4e8f-bead-df0674ab46e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:05.966617 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03bbf21f-c5dd-4e8f-bead-df0674ab46e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:05.967458 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03bbf21f-c5dd-4e8f-bead-df0674ab46e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:05.968008 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03bbf21f-c5dd-4e8f-bead-df0674ab46e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:05.968508 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03bbf21f-c5dd-4e8f-bead-df0674ab46e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:06.059748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e80d1ed7-08f3-4216-956c-ab8a12451bed tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:06.067488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e80d1ed7-08f3-4216-956c-ab8a12451bed tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.185619 Aug 04 22:26:06.068392 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 343/680] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:05 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:06.108076 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-03bbf21f-c5dd-4e8f-bead-df0674ab46e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:06.119813 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-03bbf21f-c5dd-4e8f-bead-df0674ab46e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:06.121308 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-03bbf21f-c5dd-4e8f-bead-df0674ab46e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:06.122512 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-03bbf21f-c5dd-4e8f-bead-df0674ab46e2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.179884 Aug 04 22:26:06.123060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 338/681] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:05 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:26:07.088104 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-126bd93c-4d1b-43ac-b7d3-d6a219fd4584 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:07.088720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-126bd93c-4d1b-43ac-b7d3-d6a219fd4584 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:07.094749 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-126bd93c-4d1b-43ac-b7d3-d6a219fd4584 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:07.095227 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-126bd93c-4d1b-43ac-b7d3-d6a219fd4584 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:07.095655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-126bd93c-4d1b-43ac-b7d3-d6a219fd4584 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:07.096339 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-126bd93c-4d1b-43ac-b7d3-d6a219fd4584 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:07.096785 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-126bd93c-4d1b-43ac-b7d3-d6a219fd4584 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:07.097275 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-126bd93c-4d1b-43ac-b7d3-d6a219fd4584 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:07.144845 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-84d89713-fdfa-4609-ba91-4798f3594e5c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:07.145529 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-84d89713-fdfa-4609-ba91-4798f3594e5c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:07.152068 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84d89713-fdfa-4609-ba91-4798f3594e5c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:07.152542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84d89713-fdfa-4609-ba91-4798f3594e5c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:07.152970 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84d89713-fdfa-4609-ba91-4798f3594e5c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:07.153695 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84d89713-fdfa-4609-ba91-4798f3594e5c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:07.154146 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84d89713-fdfa-4609-ba91-4798f3594e5c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:07.154568 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84d89713-fdfa-4609-ba91-4798f3594e5c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:07.230887 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-126bd93c-4d1b-43ac-b7d3-d6a219fd4584 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:07.239084 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-126bd93c-4d1b-43ac-b7d3-d6a219fd4584 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.154866 Aug 04 22:26:07.239767 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 344/682] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:07 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:07.290368 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-84d89713-fdfa-4609-ba91-4798f3594e5c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:07.298524 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-84d89713-fdfa-4609-ba91-4798f3594e5c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:07.300004 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-84d89713-fdfa-4609-ba91-4798f3594e5c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:07.301846 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-84d89713-fdfa-4609-ba91-4798f3594e5c tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.161046 Aug 04 22:26:07.302398 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 339/683] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:07 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:26:08.260625 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-10b5c298-209d-4b2d-b191-99e9192bad83 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:08.261231 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-10b5c298-209d-4b2d-b191-99e9192bad83 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:08.267177 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-10b5c298-209d-4b2d-b191-99e9192bad83 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:08.267660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-10b5c298-209d-4b2d-b191-99e9192bad83 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:08.268092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-10b5c298-209d-4b2d-b191-99e9192bad83 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:08.268782 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-10b5c298-209d-4b2d-b191-99e9192bad83 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:08.270485 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-10b5c298-209d-4b2d-b191-99e9192bad83 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:08.270911 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-10b5c298-209d-4b2d-b191-99e9192bad83 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:08.324079 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6ba6b084-3946-45d9-b4f9-d617c61b7eba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:08.324669 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6ba6b084-3946-45d9-b4f9-d617c61b7eba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:08.331972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ba6b084-3946-45d9-b4f9-d617c61b7eba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:08.332685 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ba6b084-3946-45d9-b4f9-d617c61b7eba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:08.332915 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ba6b084-3946-45d9-b4f9-d617c61b7eba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:08.333641 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ba6b084-3946-45d9-b4f9-d617c61b7eba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:08.334099 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ba6b084-3946-45d9-b4f9-d617c61b7eba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:08.334526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6ba6b084-3946-45d9-b4f9-d617c61b7eba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:08.405032 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-10b5c298-209d-4b2d-b191-99e9192bad83 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:08.412664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-10b5c298-209d-4b2d-b191-99e9192bad83 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.155821 Aug 04 22:26:08.413236 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 345/684] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:08 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:08.468697 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6ba6b084-3946-45d9-b4f9-d617c61b7eba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:08.477368 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6ba6b084-3946-45d9-b4f9-d617c61b7eba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:08.478876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6ba6b084-3946-45d9-b4f9-d617c61b7eba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:08.480016 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6ba6b084-3946-45d9-b4f9-d617c61b7eba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.159870 Aug 04 22:26:08.480628 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 340/685] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:08 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:26:09.433865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6a769286-9f93-4eb8-80ca-985349150632 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:09.434446 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6a769286-9f93-4eb8-80ca-985349150632 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:09.440362 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6a769286-9f93-4eb8-80ca-985349150632 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:09.440851 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6a769286-9f93-4eb8-80ca-985349150632 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:09.441474 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6a769286-9f93-4eb8-80ca-985349150632 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:09.442177 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6a769286-9f93-4eb8-80ca-985349150632 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:09.442638 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6a769286-9f93-4eb8-80ca-985349150632 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:09.443066 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6a769286-9f93-4eb8-80ca-985349150632 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:09.504718 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9b088120-2a87-40a7-bf5e-4ecdb358b359 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:09.505315 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9b088120-2a87-40a7-bf5e-4ecdb358b359 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:09.511716 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9b088120-2a87-40a7-bf5e-4ecdb358b359 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:09.512199 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9b088120-2a87-40a7-bf5e-4ecdb358b359 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:09.512632 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9b088120-2a87-40a7-bf5e-4ecdb358b359 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:09.513327 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9b088120-2a87-40a7-bf5e-4ecdb358b359 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:09.513947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9b088120-2a87-40a7-bf5e-4ecdb358b359 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:09.514376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9b088120-2a87-40a7-bf5e-4ecdb358b359 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:09.573214 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6a769286-9f93-4eb8-80ca-985349150632 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:09.580874 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6a769286-9f93-4eb8-80ca-985349150632 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.150929 Aug 04 22:26:09.582114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 346/686] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:09 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:09.642424 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9b088120-2a87-40a7-bf5e-4ecdb358b359 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:09.651528 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9b088120-2a87-40a7-bf5e-4ecdb358b359 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:09.653028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9b088120-2a87-40a7-bf5e-4ecdb358b359 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:09.654212 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9b088120-2a87-40a7-bf5e-4ecdb358b359 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.154405 Aug 04 22:26:09.654775 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 341/687] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:09 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:26:10.602707 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-da889658-3ac3-41fb-81bd-7c4e1e9fb1d5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:10.603326 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-da889658-3ac3-41fb-81bd-7c4e1e9fb1d5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:10.609494 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-da889658-3ac3-41fb-81bd-7c4e1e9fb1d5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:10.609978 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-da889658-3ac3-41fb-81bd-7c4e1e9fb1d5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:10.610664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-da889658-3ac3-41fb-81bd-7c4e1e9fb1d5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:10.611372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-da889658-3ac3-41fb-81bd-7c4e1e9fb1d5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:10.611822 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-da889658-3ac3-41fb-81bd-7c4e1e9fb1d5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:10.612238 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-da889658-3ac3-41fb-81bd-7c4e1e9fb1d5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:10.676082 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-21548ff3-8435-4230-b7ff-d0867ac5a167 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:10.677138 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-21548ff3-8435-4230-b7ff-d0867ac5a167 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:10.683268 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-21548ff3-8435-4230-b7ff-d0867ac5a167 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:10.683756 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-21548ff3-8435-4230-b7ff-d0867ac5a167 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:10.684188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-21548ff3-8435-4230-b7ff-d0867ac5a167 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:10.684884 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-21548ff3-8435-4230-b7ff-d0867ac5a167 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:10.685336 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-21548ff3-8435-4230-b7ff-d0867ac5a167 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:10.685785 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-21548ff3-8435-4230-b7ff-d0867ac5a167 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:10.741051 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-da889658-3ac3-41fb-81bd-7c4e1e9fb1d5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:10.748732 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-da889658-3ac3-41fb-81bd-7c4e1e9fb1d5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.150411 Aug 04 22:26:10.749259 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 347/688] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:10 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:10.821334 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-21548ff3-8435-4230-b7ff-d0867ac5a167 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:10.829728 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-21548ff3-8435-4230-b7ff-d0867ac5a167 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:10.831220 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-21548ff3-8435-4230-b7ff-d0867ac5a167 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:10.832379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-21548ff3-8435-4230-b7ff-d0867ac5a167 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.160134 Aug 04 22:26:10.833643 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 342/689] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:10 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:26:11.770384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-eaca39ca-8939-4743-84d4-77b5620a47e7 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:11.771010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-eaca39ca-8939-4743-84d4-77b5620a47e7 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:11.777004 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eaca39ca-8939-4743-84d4-77b5620a47e7 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:11.777553 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eaca39ca-8939-4743-84d4-77b5620a47e7 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:11.777996 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eaca39ca-8939-4743-84d4-77b5620a47e7 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:11.778696 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eaca39ca-8939-4743-84d4-77b5620a47e7 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:11.779152 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eaca39ca-8939-4743-84d4-77b5620a47e7 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:11.779578 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eaca39ca-8939-4743-84d4-77b5620a47e7 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:11.855779 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f1c86ad6-338e-46d8-bc1c-d3731e3d1808 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:11.856376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f1c86ad6-338e-46d8-bc1c-d3731e3d1808 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:11.863155 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f1c86ad6-338e-46d8-bc1c-d3731e3d1808 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:11.863642 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f1c86ad6-338e-46d8-bc1c-d3731e3d1808 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:11.864903 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f1c86ad6-338e-46d8-bc1c-d3731e3d1808 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:11.866039 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f1c86ad6-338e-46d8-bc1c-d3731e3d1808 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:11.866507 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f1c86ad6-338e-46d8-bc1c-d3731e3d1808 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:11.866935 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f1c86ad6-338e-46d8-bc1c-d3731e3d1808 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:12.013585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f1c86ad6-338e-46d8-bc1c-d3731e3d1808 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:12.022708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f1c86ad6-338e-46d8-bc1c-d3731e3d1808 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:12.023046 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-eaca39ca-8939-4743-84d4-77b5620a47e7 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:12.024205 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f1c86ad6-338e-46d8-bc1c-d3731e3d1808 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:12.025775 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f1c86ad6-338e-46d8-bc1c-d3731e3d1808 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.173857 Aug 04 22:26:12.026317 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 343/690] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:11 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:26:12.032706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-eaca39ca-8939-4743-84d4-77b5620a47e7 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 200 len: 1517 microversion: 2.1 time: 0.266230 Aug 04 22:26:12.033284 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 348/691] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:11 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 1517 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:12.183909 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-a98cb1b6-05d4-400a-9f2d-2681b34fd3dd req-15a496fd-287c-4a0a-9658-f2fb1bc35e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3daf69-e689-453d-81d4-9eba29e8f352", "name": "network-vif-deleted", "tag": "2d51d6ec-ea63-4dc6-983d-b1edffe34560"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:26:12.193018 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a98cb1b6-05d4-400a-9f2d-2681b34fd3dd req-15a496fd-287c-4a0a-9658-f2fb1bc35e0e service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:12.193506 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a98cb1b6-05d4-400a-9f2d-2681b34fd3dd req-15a496fd-287c-4a0a-9658-f2fb1bc35e0e service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:12.193928 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a98cb1b6-05d4-400a-9f2d-2681b34fd3dd req-15a496fd-287c-4a0a-9658-f2fb1bc35e0e service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:12.204509 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-a98cb1b6-05d4-400a-9f2d-2681b34fd3dd req-15a496fd-287c-4a0a-9658-f2fb1bc35e0e service nova] Creating event network-vif-deleted:2d51d6ec-ea63-4dc6-983d-b1edffe34560 for instance 9e3daf69-e689-453d-81d4-9eba29e8f352 on hv-cinder-85221 Aug 04 22:26:12.210322 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-a98cb1b6-05d4-400a-9f2d-2681b34fd3dd req-15a496fd-287c-4a0a-9658-f2fb1bc35e0e service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029585 Aug 04 22:26:12.210656 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 344/692] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:26:13.050084 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1b4ef335-b60e-48eb-8b67-86c4a4485905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:13.050967 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1b4ef335-b60e-48eb-8b67-86c4a4485905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:13.055956 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-49e890d2-c6e7-4858-8b03-d8ab83a35d6a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:13.056792 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-49e890d2-c6e7-4858-8b03-d8ab83a35d6a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 9e3daf69-e689-453d-81d4-9eba29e8f352] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:13.056983 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b4ef335-b60e-48eb-8b67-86c4a4485905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:13.057492 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b4ef335-b60e-48eb-8b67-86c4a4485905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:13.057927 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b4ef335-b60e-48eb-8b67-86c4a4485905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:13.058619 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b4ef335-b60e-48eb-8b67-86c4a4485905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:13.059071 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b4ef335-b60e-48eb-8b67-86c4a4485905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:13.059489 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1b4ef335-b60e-48eb-8b67-86c4a4485905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:13.063033 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-49e890d2-c6e7-4858-8b03-d8ab83a35d6a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:13.063518 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-49e890d2-c6e7-4858-8b03-d8ab83a35d6a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:13.063953 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-49e890d2-c6e7-4858-8b03-d8ab83a35d6a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:13.064650 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-49e890d2-c6e7-4858-8b03-d8ab83a35d6a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:13.065104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-49e890d2-c6e7-4858-8b03-d8ab83a35d6a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:13.065632 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-49e890d2-c6e7-4858-8b03-d8ab83a35d6a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:13.079781 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-49e890d2-c6e7-4858-8b03-d8ab83a35d6a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] HTTP exception thrown: Instance 9e3daf69-e689-453d-81d4-9eba29e8f352 could not be found. Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-49e890d2-c6e7-4858-8b03-d8ab83a35d6a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Request method failure captured: Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 HTTP/1.1 Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EcK-xizfYuTztokNxlRmm8RowF8EBsEl8d2OsWA1AoBus5aBZARG7_jgT7aYbJQCVs5TosU9JVdxhbqd9cd5vvGJmByH1omB32ynlqJWswy-vfneJ1erHL13c2tKoHPNEn54yOXjnpD8ev4Zg1zfp09tq5B-mtk5qGP_GEvuYe16Ss Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 260c01e60f5e48ac9420c388a958e0ee Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1299201218 Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:26:13.081417 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:26:13.082808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/260c01e60f5e48ac9420c388a958e0ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_260c01e60f5e48ac9420c388a958e0ee", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/260c01e60f5e48ac9420c388a958e0ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/260c01e60f5e48ac9420c388a958e0ee"}]}] Aug 04 22:26:13.082808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-VolumesSnapshotTestJSON-1299201218 Aug 04 22:26:13.082808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 260c01e60f5e48ac9420c388a958e0ee Aug 04 22:26:13.082808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1299201218 Aug 04 22:26:13.082808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-VolumesSnapshotTestJSON-1299201218-project Aug 04 22:26:13.082808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:26:13.082808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:26:13.082808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 91dd37f744a5476488afe91d97a406a1 Aug 04 22:26:13.082808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-VolumesSnapshotTestJSON-1299201218-project Aug 04 22:26:13.082808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:26:13.082808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance 9e3daf69-e689-453d-81d4-9eba29e8f352 could not be found. Aug 04 22:26:13.082808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': '9e3daf69-e689-453d-81d4-9eba29e8f352'} Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e3daf69-e689-453d-81d4-9eba29e8f352 could not be found. Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:26:13.083606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e3daf69-e689-453d-81d4-9eba29e8f352 could not be found. Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e3daf69-e689-453d-81d4-9eba29e8f352 could not be found. Aug 04 22:26:13.084876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:26:13.089889 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-49e890d2-c6e7-4858-8b03-d8ab83a35d6a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Returning 404 to user: Instance 9e3daf69-e689-453d-81d4-9eba29e8f352 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:26:13.089889 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-49e890d2-c6e7-4858-8b03-d8ab83a35d6a tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352" status: 404 len: 111 microversion: 2.1 time: 0.032331 Aug 04 22:26:13.089889 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 345/693] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:13 2022] GET /compute/v2.1/servers/9e3daf69-e689-453d-81d4-9eba29e8f352 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 22:26:13.194089 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1b4ef335-b60e-48eb-8b67-86c4a4485905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:13.203062 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1b4ef335-b60e-48eb-8b67-86c4a4485905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:13.204581 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1b4ef335-b60e-48eb-8b67-86c4a4485905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:13.205780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1b4ef335-b60e-48eb-8b67-86c4a4485905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.159722 Aug 04 22:26:13.206345 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 349/694] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:13 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:14.228540 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c18a9b84-dd5f-4147-a4b9-3ec71e1481af tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:14.229180 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c18a9b84-dd5f-4147-a4b9-3ec71e1481af tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:14.235869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c18a9b84-dd5f-4147-a4b9-3ec71e1481af tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:14.236349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c18a9b84-dd5f-4147-a4b9-3ec71e1481af tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:14.236784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c18a9b84-dd5f-4147-a4b9-3ec71e1481af tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:14.237499 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c18a9b84-dd5f-4147-a4b9-3ec71e1481af tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:14.237955 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c18a9b84-dd5f-4147-a4b9-3ec71e1481af tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:14.238384 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c18a9b84-dd5f-4147-a4b9-3ec71e1481af tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:14.385035 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c18a9b84-dd5f-4147-a4b9-3ec71e1481af tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:14.393503 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c18a9b84-dd5f-4147-a4b9-3ec71e1481af tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:14.395052 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c18a9b84-dd5f-4147-a4b9-3ec71e1481af tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:14.396203 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c18a9b84-dd5f-4147-a4b9-3ec71e1481af tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.171583 Aug 04 22:26:14.396749 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 346/695] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:14 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:26:15.420127 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c3045143-9132-42f3-9518-afdcd8e77539 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:15.420648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c3045143-9132-42f3-9518-afdcd8e77539 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:15.426776 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c3045143-9132-42f3-9518-afdcd8e77539 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:15.427285 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c3045143-9132-42f3-9518-afdcd8e77539 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:15.427801 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c3045143-9132-42f3-9518-afdcd8e77539 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:15.428525 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c3045143-9132-42f3-9518-afdcd8e77539 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:15.428983 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c3045143-9132-42f3-9518-afdcd8e77539 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:15.429429 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c3045143-9132-42f3-9518-afdcd8e77539 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:15.555671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c3045143-9132-42f3-9518-afdcd8e77539 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:15.564001 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c3045143-9132-42f3-9518-afdcd8e77539 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:15.565530 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c3045143-9132-42f3-9518-afdcd8e77539 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:15.567399 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c3045143-9132-42f3-9518-afdcd8e77539 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.150508 Aug 04 22:26:15.567966 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 350/696] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:15 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:16.589657 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-57e79be5-01c4-4278-b4bb-0cdf47f36ae8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:16.590294 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-57e79be5-01c4-4278-b4bb-0cdf47f36ae8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:16.596574 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57e79be5-01c4-4278-b4bb-0cdf47f36ae8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:16.597047 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57e79be5-01c4-4278-b4bb-0cdf47f36ae8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:16.597500 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57e79be5-01c4-4278-b4bb-0cdf47f36ae8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:16.598941 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57e79be5-01c4-4278-b4bb-0cdf47f36ae8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:16.599401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57e79be5-01c4-4278-b4bb-0cdf47f36ae8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:16.599823 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57e79be5-01c4-4278-b4bb-0cdf47f36ae8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:16.727987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-57e79be5-01c4-4278-b4bb-0cdf47f36ae8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:16.736586 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-57e79be5-01c4-4278-b4bb-0cdf47f36ae8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:16.738120 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-57e79be5-01c4-4278-b4bb-0cdf47f36ae8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:16.739429 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-57e79be5-01c4-4278-b4bb-0cdf47f36ae8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.153648 Aug 04 22:26:16.740022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 347/697] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:16 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:17.761203 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7681854c-8ec3-4260-b09e-76b0f8a6b774 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:17.761766 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7681854c-8ec3-4260-b09e-76b0f8a6b774 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:17.767695 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7681854c-8ec3-4260-b09e-76b0f8a6b774 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:17.768180 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7681854c-8ec3-4260-b09e-76b0f8a6b774 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:17.768624 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7681854c-8ec3-4260-b09e-76b0f8a6b774 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:17.769300 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7681854c-8ec3-4260-b09e-76b0f8a6b774 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:17.770296 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7681854c-8ec3-4260-b09e-76b0f8a6b774 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:17.770889 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7681854c-8ec3-4260-b09e-76b0f8a6b774 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:17.904137 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7681854c-8ec3-4260-b09e-76b0f8a6b774 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:17.913074 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7681854c-8ec3-4260-b09e-76b0f8a6b774 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:17.914831 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7681854c-8ec3-4260-b09e-76b0f8a6b774 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:17.916606 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7681854c-8ec3-4260-b09e-76b0f8a6b774 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.159122 Aug 04 22:26:17.917244 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 351/698] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:17 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:26:18.940439 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e5738f16-de04-4d90-8f2d-6d5cee7b263b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:18.941042 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e5738f16-de04-4d90-8f2d-6d5cee7b263b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:18.948659 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e5738f16-de04-4d90-8f2d-6d5cee7b263b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:18.949139 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e5738f16-de04-4d90-8f2d-6d5cee7b263b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:18.949607 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e5738f16-de04-4d90-8f2d-6d5cee7b263b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:18.950340 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e5738f16-de04-4d90-8f2d-6d5cee7b263b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:18.950824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e5738f16-de04-4d90-8f2d-6d5cee7b263b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:18.951266 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e5738f16-de04-4d90-8f2d-6d5cee7b263b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:19.078541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e5738f16-de04-4d90-8f2d-6d5cee7b263b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:19.087110 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e5738f16-de04-4d90-8f2d-6d5cee7b263b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:19.088587 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e5738f16-de04-4d90-8f2d-6d5cee7b263b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:19.089781 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e5738f16-de04-4d90-8f2d-6d5cee7b263b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.153270 Aug 04 22:26:19.090348 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 348/699] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:18 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:20.113911 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-33dcb711-7734-43e1-8065-816cded8bce8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:20.114304 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-33dcb711-7734-43e1-8065-816cded8bce8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:20.121153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-33dcb711-7734-43e1-8065-816cded8bce8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:20.121674 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-33dcb711-7734-43e1-8065-816cded8bce8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:20.122108 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-33dcb711-7734-43e1-8065-816cded8bce8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:20.122805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-33dcb711-7734-43e1-8065-816cded8bce8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:20.123258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-33dcb711-7734-43e1-8065-816cded8bce8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:20.123680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-33dcb711-7734-43e1-8065-816cded8bce8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:20.253921 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-33dcb711-7734-43e1-8065-816cded8bce8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:20.262609 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-33dcb711-7734-43e1-8065-816cded8bce8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:20.264086 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-33dcb711-7734-43e1-8065-816cded8bce8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:20.265222 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-33dcb711-7734-43e1-8065-816cded8bce8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.156891 Aug 04 22:26:20.265823 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 352/700] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:20 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:21.289026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e1550f81-c20e-4eb2-908a-1a1d30dd7352 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:21.289661 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e1550f81-c20e-4eb2-908a-1a1d30dd7352 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:21.296074 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1550f81-c20e-4eb2-908a-1a1d30dd7352 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:21.296556 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1550f81-c20e-4eb2-908a-1a1d30dd7352 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:21.296993 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1550f81-c20e-4eb2-908a-1a1d30dd7352 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:21.297712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1550f81-c20e-4eb2-908a-1a1d30dd7352 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:21.298168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1550f81-c20e-4eb2-908a-1a1d30dd7352 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:21.298593 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e1550f81-c20e-4eb2-908a-1a1d30dd7352 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:21.428798 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e1550f81-c20e-4eb2-908a-1a1d30dd7352 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:21.437240 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e1550f81-c20e-4eb2-908a-1a1d30dd7352 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:21.438824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e1550f81-c20e-4eb2-908a-1a1d30dd7352 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:21.440066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e1550f81-c20e-4eb2-908a-1a1d30dd7352 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.155507 Aug 04 22:26:21.440624 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 349/701] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:21 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:22.463431 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-721b4187-b580-4a85-afb9-8de0a7932b38 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:22.463977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-721b4187-b580-4a85-afb9-8de0a7932b38 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:22.469935 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-721b4187-b580-4a85-afb9-8de0a7932b38 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:22.470420 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-721b4187-b580-4a85-afb9-8de0a7932b38 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:22.470856 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-721b4187-b580-4a85-afb9-8de0a7932b38 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:22.471550 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-721b4187-b580-4a85-afb9-8de0a7932b38 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:22.472001 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-721b4187-b580-4a85-afb9-8de0a7932b38 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:22.472427 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-721b4187-b580-4a85-afb9-8de0a7932b38 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:22.615891 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-721b4187-b580-4a85-afb9-8de0a7932b38 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:22.624256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-721b4187-b580-4a85-afb9-8de0a7932b38 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:22.625784 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-721b4187-b580-4a85-afb9-8de0a7932b38 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:22.626942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-721b4187-b580-4a85-afb9-8de0a7932b38 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.167550 Aug 04 22:26:22.627495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 353/702] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:22 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:23.649752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9450c111-0922-4738-914b-71abf9ade0ce tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:23.650348 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9450c111-0922-4738-914b-71abf9ade0ce tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:23.656663 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9450c111-0922-4738-914b-71abf9ade0ce tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:23.657133 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9450c111-0922-4738-914b-71abf9ade0ce tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:23.657601 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9450c111-0922-4738-914b-71abf9ade0ce tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:23.658279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9450c111-0922-4738-914b-71abf9ade0ce tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:23.658729 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9450c111-0922-4738-914b-71abf9ade0ce tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:23.659146 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9450c111-0922-4738-914b-71abf9ade0ce tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:23.787927 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9450c111-0922-4738-914b-71abf9ade0ce tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:23.796264 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9450c111-0922-4738-914b-71abf9ade0ce tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:23.798016 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9450c111-0922-4738-914b-71abf9ade0ce tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:23.799205 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9450c111-0922-4738-914b-71abf9ade0ce tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.153324 Aug 04 22:26:23.799798 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 350/703] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:23 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:24.823842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2162bc2a-ac45-470d-ba4e-0be1ce3bc1ae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:24.824524 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2162bc2a-ac45-470d-ba4e-0be1ce3bc1ae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:24.826397 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:24.831726 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2162bc2a-ac45-470d-ba4e-0be1ce3bc1ae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:24.832220 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2162bc2a-ac45-470d-ba4e-0be1ce3bc1ae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:24.832656 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2162bc2a-ac45-470d-ba4e-0be1ce3bc1ae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:24.833350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2162bc2a-ac45-470d-ba4e-0be1ce3bc1ae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:24.834500 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2162bc2a-ac45-470d-ba4e-0be1ce3bc1ae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:24.834968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2162bc2a-ac45-470d-ba4e-0be1ce3bc1ae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:24.850422 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=100 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:24.968343 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2162bc2a-ac45-470d-ba4e-0be1ce3bc1ae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:24.976866 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2162bc2a-ac45-470d-ba4e-0be1ce3bc1ae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:24.978391 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2162bc2a-ac45-470d-ba4e-0be1ce3bc1ae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:24.979563 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2162bc2a-ac45-470d-ba4e-0be1ce3bc1ae tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.159984 Aug 04 22:26:24.996704 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 354/704] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:24 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:25.047458 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-887507597", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "networks": [{"uuid": "a25bf7f0-373b-4d07-9fb0-98e5f145ad8b"}]}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:26:25.103974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.network.neutron [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] validate_networks() for [('a25bf7f0-373b-4d07-9fb0-98e5f145ad8b', None, None, None, None, None)] {{(pid=129196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:26:25.163661 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-d1ef96c3-c770-425f-a402-5f2169f4d080 req-9428f137-c104-44af-8da8-06c294054cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb440660-4715-48f6-a7ff-f0b74dfefe21", "name": "network-vif-plugged", "status": "completed", "tag": "417dd402-4a58-49ce-a237-c5d14b0ce44d"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:26:25.173162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-d1ef96c3-c770-425f-a402-5f2169f4d080 req-9428f137-c104-44af-8da8-06c294054cf9 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:25.173827 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-d1ef96c3-c770-425f-a402-5f2169f4d080 req-9428f137-c104-44af-8da8-06c294054cf9 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:25.174263 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-d1ef96c3-c770-425f-a402-5f2169f4d080 req-9428f137-c104-44af-8da8-06c294054cf9 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:25.186340 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-d1ef96c3-c770-425f-a402-5f2169f4d080 req-9428f137-c104-44af-8da8-06c294054cf9 service nova] Creating event network-vif-plugged:417dd402-4a58-49ce-a237-c5d14b0ce44d for instance eb440660-4715-48f6-a7ff-f0b74dfefe21 on hv-cinder-85221 Aug 04 22:26:25.191534 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-d1ef96c3-c770-425f-a402-5f2169f4d080 req-9428f137-c104-44af-8da8-06c294054cf9 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103635 Aug 04 22:26:25.192134 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 355/705] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:26:25.450751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Flavor limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:26:25.451192 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Image limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:26:25.451658 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Flavor pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:26:25.452070 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Image pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:26:25.452481 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:26:25.461357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:25.461870 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:25.462310 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:25.463095 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:25.463551 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:25.463975 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:25.480823 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Getting quotas for project 260c01e60f5e48ac9420c388a958e0ee. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:26:25.485051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Getting quotas for user 91dd37f744a5476488afe91d97a406a1 and project 260c01e60f5e48ac9420c388a958e0ee. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:26:25.496502 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Going to run 1 instances... {{(pid=129196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:26:25.498745 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:26:25.542889 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e05468bb-4f9d-47f6-996d-694725ff8001 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.499759 Aug 04 22:26:25.543530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 351/706] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:26:25 2022] POST /compute/v2.1/servers => generated 382 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 04 22:26:25.555803 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6a052741-a016-4061-858f-40875c4ec5dd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:25.556614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6a052741-a016-4061-858f-40875c4ec5dd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:25.613617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6a052741-a016-4061-858f-40875c4ec5dd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:25.622086 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6a052741-a016-4061-858f-40875c4ec5dd tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1222 microversion: 2.1 time: 0.071436 Aug 04 22:26:25.622953 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 356/707] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:25 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1222 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:26.003035 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-89cc1fcd-3280-42e6-b392-308513966bdd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:26.003685 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-89cc1fcd-3280-42e6-b392-308513966bdd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:26.010412 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-89cc1fcd-3280-42e6-b392-308513966bdd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:26.010897 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-89cc1fcd-3280-42e6-b392-308513966bdd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:26.011334 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-89cc1fcd-3280-42e6-b392-308513966bdd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:26.012029 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-89cc1fcd-3280-42e6-b392-308513966bdd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:26.012487 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-89cc1fcd-3280-42e6-b392-308513966bdd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:26.012916 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-89cc1fcd-3280-42e6-b392-308513966bdd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:26.144975 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-89cc1fcd-3280-42e6-b392-308513966bdd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:26.154564 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-89cc1fcd-3280-42e6-b392-308513966bdd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:26.156099 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-89cc1fcd-3280-42e6-b392-308513966bdd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:26.157244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-89cc1fcd-3280-42e6-b392-308513966bdd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.158233 Aug 04 22:26:26.157860 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 352/708] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:25 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:26.642874 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-fd08ba48-0b0d-4bb0-8356-d58905db9231 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:26.643515 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-fd08ba48-0b0d-4bb0-8356-d58905db9231 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:26.649656 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fd08ba48-0b0d-4bb0-8356-d58905db9231 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:26.650136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fd08ba48-0b0d-4bb0-8356-d58905db9231 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:26.650569 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fd08ba48-0b0d-4bb0-8356-d58905db9231 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:26.651257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fd08ba48-0b0d-4bb0-8356-d58905db9231 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:26.651756 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fd08ba48-0b0d-4bb0-8356-d58905db9231 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:26.652185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fd08ba48-0b0d-4bb0-8356-d58905db9231 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:26.712385 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-fd08ba48-0b0d-4bb0-8356-d58905db9231 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:26.719811 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-fd08ba48-0b0d-4bb0-8356-d58905db9231 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1218 microversion: 2.1 time: 0.080852 Aug 04 22:26:26.720369 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 357/709] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:26 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:27.180814 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-cbc53c8b-ab1d-4c9b-a55f-b21a0b1a6064 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:27.181554 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-cbc53c8b-ab1d-4c9b-a55f-b21a0b1a6064 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:27.187866 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cbc53c8b-ab1d-4c9b-a55f-b21a0b1a6064 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:27.188351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cbc53c8b-ab1d-4c9b-a55f-b21a0b1a6064 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:27.188786 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cbc53c8b-ab1d-4c9b-a55f-b21a0b1a6064 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:27.189499 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cbc53c8b-ab1d-4c9b-a55f-b21a0b1a6064 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:27.189952 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cbc53c8b-ab1d-4c9b-a55f-b21a0b1a6064 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:27.190371 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cbc53c8b-ab1d-4c9b-a55f-b21a0b1a6064 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:27.325748 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-cbc53c8b-ab1d-4c9b-a55f-b21a0b1a6064 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:27.335260 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-cbc53c8b-ab1d-4c9b-a55f-b21a0b1a6064 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:27.336779 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-cbc53c8b-ab1d-4c9b-a55f-b21a0b1a6064 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:27.337965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-cbc53c8b-ab1d-4c9b-a55f-b21a0b1a6064 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.161757 Aug 04 22:26:27.338523 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 353/710] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:27 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:27.742195 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bae79c79-e103-4b51-ac72-2b761e425b04 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:27.742814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bae79c79-e103-4b51-ac72-2b761e425b04 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:27.748721 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bae79c79-e103-4b51-ac72-2b761e425b04 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:27.749233 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bae79c79-e103-4b51-ac72-2b761e425b04 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:27.749778 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bae79c79-e103-4b51-ac72-2b761e425b04 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:27.750467 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bae79c79-e103-4b51-ac72-2b761e425b04 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:27.751154 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bae79c79-e103-4b51-ac72-2b761e425b04 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:27.751464 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bae79c79-e103-4b51-ac72-2b761e425b04 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:27.822430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bae79c79-e103-4b51-ac72-2b761e425b04 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:27.830062 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bae79c79-e103-4b51-ac72-2b761e425b04 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1274 microversion: 2.1 time: 0.092732 Aug 04 22:26:27.830603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 358/711] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:27 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:28.362642 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0f06a9ce-7223-454f-8c32-d376792aacbf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:28.363192 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0f06a9ce-7223-454f-8c32-d376792aacbf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:28.370463 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f06a9ce-7223-454f-8c32-d376792aacbf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:28.370962 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f06a9ce-7223-454f-8c32-d376792aacbf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:28.371408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f06a9ce-7223-454f-8c32-d376792aacbf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:28.372100 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f06a9ce-7223-454f-8c32-d376792aacbf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:28.372556 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f06a9ce-7223-454f-8c32-d376792aacbf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:28.372984 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0f06a9ce-7223-454f-8c32-d376792aacbf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:28.533456 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0f06a9ce-7223-454f-8c32-d376792aacbf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:28.535837 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:28.543931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0f06a9ce-7223-454f-8c32-d376792aacbf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:28.545507 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0f06a9ce-7223-454f-8c32-d376792aacbf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:28.546666 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0f06a9ce-7223-454f-8c32-d376792aacbf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1813 microversion: 2.20 time: 0.188275 Aug 04 22:26:28.547222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 354/712] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:28 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1813 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:28.851136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-007aca15-44f1-4480-a5d7-a4836dcd5ae0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:28.851784 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-007aca15-44f1-4480-a5d7-a4836dcd5ae0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:28.857731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-007aca15-44f1-4480-a5d7-a4836dcd5ae0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:28.858175 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-007aca15-44f1-4480-a5d7-a4836dcd5ae0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:28.858798 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-007aca15-44f1-4480-a5d7-a4836dcd5ae0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:28.859771 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-007aca15-44f1-4480-a5d7-a4836dcd5ae0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:28.860231 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-007aca15-44f1-4480-a5d7-a4836dcd5ae0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:28.860660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-007aca15-44f1-4480-a5d7-a4836dcd5ae0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:28.955632 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-007aca15-44f1-4480-a5d7-a4836dcd5ae0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:28.963087 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-007aca15-44f1-4480-a5d7-a4836dcd5ae0 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1280 microversion: 2.1 time: 0.115849 Aug 04 22:26:28.963893 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 359/713] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:28 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1280 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:29.570359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a32eb148-9bd9-4196-b71b-9ca632680b12 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:29.570965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a32eb148-9bd9-4196-b71b-9ca632680b12 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:29.577493 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a32eb148-9bd9-4196-b71b-9ca632680b12 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:29.578022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a32eb148-9bd9-4196-b71b-9ca632680b12 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:29.578383 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a32eb148-9bd9-4196-b71b-9ca632680b12 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:29.579074 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a32eb148-9bd9-4196-b71b-9ca632680b12 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:29.579523 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a32eb148-9bd9-4196-b71b-9ca632680b12 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:29.579941 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a32eb148-9bd9-4196-b71b-9ca632680b12 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:29.682140 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-b194cb17-4446-44d1-98cd-e4c145c187de req-0cb5f82f-3f30-4426-8d74-84e793b66581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17abd746-07d4-49ed-a0bb-05eedb87a27b", "tag": "0641aa55-262e-4c48-b76a-9decd38a0a6d"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:26:29.695672 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-b194cb17-4446-44d1-98cd-e4c145c187de req-0cb5f82f-3f30-4426-8d74-84e793b66581 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:29.696419 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-b194cb17-4446-44d1-98cd-e4c145c187de req-0cb5f82f-3f30-4426-8d74-84e793b66581 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:29.696841 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-b194cb17-4446-44d1-98cd-e4c145c187de req-0cb5f82f-3f30-4426-8d74-84e793b66581 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:29.708341 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-b194cb17-4446-44d1-98cd-e4c145c187de req-0cb5f82f-3f30-4426-8d74-84e793b66581 service nova] Creating event network-changed:0641aa55-262e-4c48-b76a-9decd38a0a6d for instance 17abd746-07d4-49ed-a0bb-05eedb87a27b on hv-cinder-85221 Aug 04 22:26:29.713729 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-b194cb17-4446-44d1-98cd-e4c145c187de req-0cb5f82f-3f30-4426-8d74-84e793b66581 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041576 Aug 04 22:26:29.714329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 360/714] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:26:29.719923 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a32eb148-9bd9-4196-b71b-9ca632680b12 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:29.731326 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a32eb148-9bd9-4196-b71b-9ca632680b12 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:29.733506 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a32eb148-9bd9-4196-b71b-9ca632680b12 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:29.734967 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a32eb148-9bd9-4196-b71b-9ca632680b12 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1800 microversion: 2.20 time: 0.169033 Aug 04 22:26:29.735524 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 355/715] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:26:29 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:26:29.984921 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4233c542-b4a5-473e-b781-91f961093c0d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:29.985581 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4233c542-b4a5-473e-b781-91f961093c0d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:29.991817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4233c542-b4a5-473e-b781-91f961093c0d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:29.992300 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4233c542-b4a5-473e-b781-91f961093c0d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:29.992748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4233c542-b4a5-473e-b781-91f961093c0d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:29.993427 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4233c542-b4a5-473e-b781-91f961093c0d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:29.993965 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4233c542-b4a5-473e-b781-91f961093c0d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:29.994374 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4233c542-b4a5-473e-b781-91f961093c0d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:30.201326 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4233c542-b4a5-473e-b781-91f961093c0d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:30.210498 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4233c542-b4a5-473e-b781-91f961093c0d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1322 microversion: 2.1 time: 0.228889 Aug 04 22:26:30.211084 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 361/716] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:29 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:31.231136 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-2292ad4b-62a9-43f2-a18b-a955c5a8eca1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:31.231752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-2292ad4b-62a9-43f2-a18b-a955c5a8eca1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:31.233781 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:31.240256 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2292ad4b-62a9-43f2-a18b-a955c5a8eca1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:31.240746 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2292ad4b-62a9-43f2-a18b-a955c5a8eca1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:31.241181 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2292ad4b-62a9-43f2-a18b-a955c5a8eca1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:31.242007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2292ad4b-62a9-43f2-a18b-a955c5a8eca1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:31.242489 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2292ad4b-62a9-43f2-a18b-a955c5a8eca1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:31.242936 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2292ad4b-62a9-43f2-a18b-a955c5a8eca1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:31.372878 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2292ad4b-62a9-43f2-a18b-a955c5a8eca1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:31.380225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-2292ad4b-62a9-43f2-a18b-a955c5a8eca1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1322 microversion: 2.1 time: 0.152906 Aug 04 22:26:31.380794 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 356/717] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:31 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:32.401726 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-40699037-b13c-4773-934e-c8f147277c2d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:32.402272 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-40699037-b13c-4773-934e-c8f147277c2d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:32.408856 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-40699037-b13c-4773-934e-c8f147277c2d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:32.409349 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-40699037-b13c-4773-934e-c8f147277c2d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:32.409818 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-40699037-b13c-4773-934e-c8f147277c2d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:32.410512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-40699037-b13c-4773-934e-c8f147277c2d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:32.410971 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-40699037-b13c-4773-934e-c8f147277c2d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:32.411400 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-40699037-b13c-4773-934e-c8f147277c2d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:32.781240 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-40699037-b13c-4773-934e-c8f147277c2d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:32.789308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-40699037-b13c-4773-934e-c8f147277c2d tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1322 microversion: 2.1 time: 0.391516 Aug 04 22:26:32.790015 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 362/718] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:32 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:32.896317 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-860fdc31-39af-4c76-8deb-e665246894d8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e569f8d1-1b78-469c-a193-f3c2426d680f"}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:26:32.898832 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-860fdc31-39af-4c76-8deb-e665246894d8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:32.904843 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-860fdc31-39af-4c76-8deb-e665246894d8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:32.905590 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-860fdc31-39af-4c76-8deb-e665246894d8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:32.906020 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-860fdc31-39af-4c76-8deb-e665246894d8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:32.906873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-860fdc31-39af-4c76-8deb-e665246894d8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:32.908288 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-860fdc31-39af-4c76-8deb-e665246894d8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:32.908820 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-860fdc31-39af-4c76-8deb-e665246894d8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:33.290833 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-860fdc31-39af-4c76-8deb-e665246894d8 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "POST /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.498513 Aug 04 22:26:33.291820 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 357/719] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:26:32 2022] POST /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-volume_attachments => generated 194 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:26:33.810677 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4c880f6a-8991-4894-9ff2-1030aeff18a4 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:33.811216 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4c880f6a-8991-4894-9ff2-1030aeff18a4 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:33.816936 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4c880f6a-8991-4894-9ff2-1030aeff18a4 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:33.817667 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4c880f6a-8991-4894-9ff2-1030aeff18a4 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:33.818100 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4c880f6a-8991-4894-9ff2-1030aeff18a4 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:33.819354 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4c880f6a-8991-4894-9ff2-1030aeff18a4 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:33.820000 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4c880f6a-8991-4894-9ff2-1030aeff18a4 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:33.820406 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4c880f6a-8991-4894-9ff2-1030aeff18a4 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:34.010219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4c880f6a-8991-4894-9ff2-1030aeff18a4 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:34.017793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4c880f6a-8991-4894-9ff2-1030aeff18a4 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1322 microversion: 2.1 time: 0.210947 Aug 04 22:26:34.018365 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 363/720] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:33 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:35.040777 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ab226edd-845c-4a52-b34c-835a07c19bc5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:35.041500 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ab226edd-845c-4a52-b34c-835a07c19bc5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:35.047611 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab226edd-845c-4a52-b34c-835a07c19bc5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:35.048089 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab226edd-845c-4a52-b34c-835a07c19bc5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:35.048520 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab226edd-845c-4a52-b34c-835a07c19bc5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:35.049201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab226edd-845c-4a52-b34c-835a07c19bc5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:35.049683 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab226edd-845c-4a52-b34c-835a07c19bc5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:35.050106 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ab226edd-845c-4a52-b34c-835a07c19bc5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:35.185051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-ab226edd-845c-4a52-b34c-835a07c19bc5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:35.192458 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ab226edd-845c-4a52-b34c-835a07c19bc5 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1322 microversion: 2.1 time: 0.156415 Aug 04 22:26:35.193027 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 358/721] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:35 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:35.529393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-c6910809-3f3e-4e20-b235-515838f9841c req-4ef0a74f-eafa-4ff3-ae5f-8429215e78a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17abd746-07d4-49ed-a0bb-05eedb87a27b", "name": "network-vif-plugged", "status": "completed", "tag": "0641aa55-262e-4c48-b76a-9decd38a0a6d"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:26:35.544140 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c6910809-3f3e-4e20-b235-515838f9841c req-4ef0a74f-eafa-4ff3-ae5f-8429215e78a6 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:35.544696 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c6910809-3f3e-4e20-b235-515838f9841c req-4ef0a74f-eafa-4ff3-ae5f-8429215e78a6 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:35.545393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c6910809-3f3e-4e20-b235-515838f9841c req-4ef0a74f-eafa-4ff3-ae5f-8429215e78a6 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:35.557889 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-c6910809-3f3e-4e20-b235-515838f9841c req-4ef0a74f-eafa-4ff3-ae5f-8429215e78a6 service nova] Creating event network-vif-plugged:0641aa55-262e-4c48-b76a-9decd38a0a6d for instance 17abd746-07d4-49ed-a0bb-05eedb87a27b on hv-cinder-85221 Aug 04 22:26:35.563023 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-c6910809-3f3e-4e20-b235-515838f9841c req-4ef0a74f-eafa-4ff3-ae5f-8429215e78a6 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037393 Aug 04 22:26:35.563718 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 364/722] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:26:36.213647 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5dd207d0-ed56-457c-a1b8-0461ddbe9842 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:36.214263 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5dd207d0-ed56-457c-a1b8-0461ddbe9842 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:36.216641 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:36.217465 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=6 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:36.225538 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5dd207d0-ed56-457c-a1b8-0461ddbe9842 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:36.226042 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5dd207d0-ed56-457c-a1b8-0461ddbe9842 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:36.226482 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5dd207d0-ed56-457c-a1b8-0461ddbe9842 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:36.227189 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5dd207d0-ed56-457c-a1b8-0461ddbe9842 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:36.227644 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5dd207d0-ed56-457c-a1b8-0461ddbe9842 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:36.228071 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5dd207d0-ed56-457c-a1b8-0461ddbe9842 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:36.369441 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5dd207d0-ed56-457c-a1b8-0461ddbe9842 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:36.377280 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5dd207d0-ed56-457c-a1b8-0461ddbe9842 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1322 microversion: 2.1 time: 0.167958 Aug 04 22:26:36.378466 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 359/723] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:36 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:36.616054 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:36.620601 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c4cae2c0-561d-4182-9832-21ef52e6a06c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:26:36.622807 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c4cae2c0-561d-4182-9832-21ef52e6a06c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:36.629115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c4cae2c0-561d-4182-9832-21ef52e6a06c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:36.629634 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c4cae2c0-561d-4182-9832-21ef52e6a06c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:36.630061 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c4cae2c0-561d-4182-9832-21ef52e6a06c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:36.631279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c4cae2c0-561d-4182-9832-21ef52e6a06c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:36.631734 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c4cae2c0-561d-4182-9832-21ef52e6a06c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:36.632152 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c4cae2c0-561d-4182-9832-21ef52e6a06c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:36.654463 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.objects.instance [None req-c4cae2c0-561d-4182-9832-21ef52e6a06c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lazy-loading 'flavor' on Instance uuid 5cca04a9-f894-43cf-b1d6-009292cdbcbb {{(pid=129197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:26:36.772607 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c4cae2c0-561d-4182-9832-21ef52e6a06c tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "POST /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/action" status: 200 len: 32 microversion: 2.1 time: 0.156555 Aug 04 22:26:36.773198 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 365/724] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:26:36 2022] POST /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 22:26:36.782461 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-fbd7fea4-f582-40da-a609-9f4763d67514 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:36.783071 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-fbd7fea4-f582-40da-a609-9f4763d67514 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:36.789670 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fbd7fea4-f582-40da-a609-9f4763d67514 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:36.790154 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fbd7fea4-f582-40da-a609-9f4763d67514 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:36.790592 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fbd7fea4-f582-40da-a609-9f4763d67514 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:36.791278 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fbd7fea4-f582-40da-a609-9f4763d67514 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:36.791731 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fbd7fea4-f582-40da-a609-9f4763d67514 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:36.792157 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fbd7fea4-f582-40da-a609-9f4763d67514 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:36.922408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-fbd7fea4-f582-40da-a609-9f4763d67514 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:36.932598 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-fbd7fea4-f582-40da-a609-9f4763d67514 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.153632 Aug 04 22:26:36.933184 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 360/725] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:36 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:37.400212 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-229e4fcb-5771-4e0a-ac1c-e545155b78b1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:37.400917 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-229e4fcb-5771-4e0a-ac1c-e545155b78b1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:37.407101 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-229e4fcb-5771-4e0a-ac1c-e545155b78b1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:37.407588 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-229e4fcb-5771-4e0a-ac1c-e545155b78b1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:37.408027 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-229e4fcb-5771-4e0a-ac1c-e545155b78b1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:37.408716 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-229e4fcb-5771-4e0a-ac1c-e545155b78b1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:37.409176 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-229e4fcb-5771-4e0a-ac1c-e545155b78b1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:37.409636 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-229e4fcb-5771-4e0a-ac1c-e545155b78b1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:37.544352 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-229e4fcb-5771-4e0a-ac1c-e545155b78b1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:37.552009 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-229e4fcb-5771-4e0a-ac1c-e545155b78b1 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1322 microversion: 2.1 time: 0.155973 Aug 04 22:26:37.552641 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 366/726] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:37 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:37.954942 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8f499094-20cd-453d-803e-887fcfad71a5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:37.955536 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8f499094-20cd-453d-803e-887fcfad71a5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:37.962601 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f499094-20cd-453d-803e-887fcfad71a5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:37.963088 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f499094-20cd-453d-803e-887fcfad71a5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:37.963524 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f499094-20cd-453d-803e-887fcfad71a5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:37.964212 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f499094-20cd-453d-803e-887fcfad71a5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:37.964680 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f499094-20cd-453d-803e-887fcfad71a5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:37.965081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f499094-20cd-453d-803e-887fcfad71a5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:38.097342 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8f499094-20cd-453d-803e-887fcfad71a5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:38.106681 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8f499094-20cd-453d-803e-887fcfad71a5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.155080 Aug 04 22:26:38.107279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 361/727] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:37 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:38.580330 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-8c150c4e-920b-42bb-9a3e-fe852e3af8a2 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:38.580947 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-8c150c4e-920b-42bb-9a3e-fe852e3af8a2 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:38.587551 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c150c4e-920b-42bb-9a3e-fe852e3af8a2 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:38.588047 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c150c4e-920b-42bb-9a3e-fe852e3af8a2 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:38.588485 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c150c4e-920b-42bb-9a3e-fe852e3af8a2 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:38.589212 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c150c4e-920b-42bb-9a3e-fe852e3af8a2 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:38.589725 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c150c4e-920b-42bb-9a3e-fe852e3af8a2 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:38.590137 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8c150c4e-920b-42bb-9a3e-fe852e3af8a2 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:38.723539 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8c150c4e-920b-42bb-9a3e-fe852e3af8a2 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:38.731172 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-8c150c4e-920b-42bb-9a3e-fe852e3af8a2 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1322 microversion: 2.1 time: 0.154756 Aug 04 22:26:38.731743 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 367/728] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:38 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:39.130114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-202bd1d3-ee99-4337-848b-ef2d0ecd8c6b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:39.131445 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-202bd1d3-ee99-4337-848b-ef2d0ecd8c6b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:39.138050 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-202bd1d3-ee99-4337-848b-ef2d0ecd8c6b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:39.138532 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-202bd1d3-ee99-4337-848b-ef2d0ecd8c6b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:39.138966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-202bd1d3-ee99-4337-848b-ef2d0ecd8c6b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:39.139657 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-202bd1d3-ee99-4337-848b-ef2d0ecd8c6b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:39.140112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-202bd1d3-ee99-4337-848b-ef2d0ecd8c6b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:39.140541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-202bd1d3-ee99-4337-848b-ef2d0ecd8c6b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:39.270788 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-202bd1d3-ee99-4337-848b-ef2d0ecd8c6b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:39.279121 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-202bd1d3-ee99-4337-848b-ef2d0ecd8c6b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.152851 Aug 04 22:26:39.279690 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 362/729] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:39 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:39.752069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-93445e77-c30c-49fb-9282-a27d522b68ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:39.752688 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-93445e77-c30c-49fb-9282-a27d522b68ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:39.758865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93445e77-c30c-49fb-9282-a27d522b68ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:39.759332 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93445e77-c30c-49fb-9282-a27d522b68ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:39.759769 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93445e77-c30c-49fb-9282-a27d522b68ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:39.760462 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93445e77-c30c-49fb-9282-a27d522b68ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:39.760917 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93445e77-c30c-49fb-9282-a27d522b68ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:39.761342 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93445e77-c30c-49fb-9282-a27d522b68ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:39.887398 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-93445e77-c30c-49fb-9282-a27d522b68ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:39.895995 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-93445e77-c30c-49fb-9282-a27d522b68ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1512 microversion: 2.1 time: 0.147712 Aug 04 22:26:39.897469 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 368/730] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:39 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:39.920150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-36d2e934-f250-426b-a981-359b84f522ab tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90308e90-3a5b-4788-83f2-811fbadba73c", "device": "/dev/sdb"}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:26:39.922910 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-36d2e934-f250-426b-a981-359b84f522ab tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:39.929545 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-36d2e934-f250-426b-a981-359b84f522ab tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:39.930066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-36d2e934-f250-426b-a981-359b84f522ab tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:39.930510 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-36d2e934-f250-426b-a981-359b84f522ab tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:39.931237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-36d2e934-f250-426b-a981-359b84f522ab tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:39.931692 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-36d2e934-f250-426b-a981-359b84f522ab tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:39.932118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-36d2e934-f250-426b-a981-359b84f522ab tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:40.188401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-36d2e934-f250-426b-a981-359b84f522ab tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "POST /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272339 Aug 04 22:26:40.189071 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 363/731] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:26:39 2022] POST /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:26:40.299795 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-425ada49-473f-4da3-bab6-ab1ab948cd5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:40.300409 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-425ada49-473f-4da3-bab6-ab1ab948cd5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:40.306558 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-425ada49-473f-4da3-bab6-ab1ab948cd5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:40.307045 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-425ada49-473f-4da3-bab6-ab1ab948cd5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:40.307521 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-425ada49-473f-4da3-bab6-ab1ab948cd5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:40.308292 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-425ada49-473f-4da3-bab6-ab1ab948cd5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:40.308674 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-425ada49-473f-4da3-bab6-ab1ab948cd5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:40.309107 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-425ada49-473f-4da3-bab6-ab1ab948cd5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:40.440936 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-425ada49-473f-4da3-bab6-ab1ab948cd5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:40.449840 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-425ada49-473f-4da3-bab6-ab1ab948cd5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.153751 Aug 04 22:26:40.450416 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 369/732] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:40 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:41.473809 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f8da2a32-6814-48c5-ae94-1bef4708ee7a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:41.474853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f8da2a32-6814-48c5-ae94-1bef4708ee7a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:41.480817 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8da2a32-6814-48c5-ae94-1bef4708ee7a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:41.481324 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8da2a32-6814-48c5-ae94-1bef4708ee7a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:41.482011 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8da2a32-6814-48c5-ae94-1bef4708ee7a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:41.482871 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8da2a32-6814-48c5-ae94-1bef4708ee7a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:41.483332 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8da2a32-6814-48c5-ae94-1bef4708ee7a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:41.484204 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8da2a32-6814-48c5-ae94-1bef4708ee7a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:41.617877 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f8da2a32-6814-48c5-ae94-1bef4708ee7a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:41.625836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f8da2a32-6814-48c5-ae94-1bef4708ee7a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.156811 Aug 04 22:26:41.626405 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 364/733] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:41 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:42.647023 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b74cf08d-6037-4785-be3e-496f516f0313 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:42.647639 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b74cf08d-6037-4785-be3e-496f516f0313 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:42.653694 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b74cf08d-6037-4785-be3e-496f516f0313 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:42.654185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b74cf08d-6037-4785-be3e-496f516f0313 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:42.654629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b74cf08d-6037-4785-be3e-496f516f0313 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:42.655325 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b74cf08d-6037-4785-be3e-496f516f0313 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:42.655781 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b74cf08d-6037-4785-be3e-496f516f0313 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:42.656210 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b74cf08d-6037-4785-be3e-496f516f0313 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:42.784174 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b74cf08d-6037-4785-be3e-496f516f0313 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:42.792837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b74cf08d-6037-4785-be3e-496f516f0313 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.149805 Aug 04 22:26:42.793439 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 370/734] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:42 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:43.814201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b0d48809-5fe4-43dd-8d5e-2b58834c1eb6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:43.814742 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b0d48809-5fe4-43dd-8d5e-2b58834c1eb6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:43.821792 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0d48809-5fe4-43dd-8d5e-2b58834c1eb6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:43.822276 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0d48809-5fe4-43dd-8d5e-2b58834c1eb6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:43.822710 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0d48809-5fe4-43dd-8d5e-2b58834c1eb6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:43.823399 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0d48809-5fe4-43dd-8d5e-2b58834c1eb6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:43.823855 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0d48809-5fe4-43dd-8d5e-2b58834c1eb6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:43.824281 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0d48809-5fe4-43dd-8d5e-2b58834c1eb6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:43.951456 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b0d48809-5fe4-43dd-8d5e-2b58834c1eb6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:43.959896 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b0d48809-5fe4-43dd-8d5e-2b58834c1eb6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.149470 Aug 04 22:26:43.960484 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 365/735] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:43 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:44.981131 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f9eee1c3-f33f-4ca7-9d5e-078a87ffb54d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:44.981773 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f9eee1c3-f33f-4ca7-9d5e-078a87ffb54d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:44.987928 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9eee1c3-f33f-4ca7-9d5e-078a87ffb54d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:44.988409 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9eee1c3-f33f-4ca7-9d5e-078a87ffb54d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:44.988845 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9eee1c3-f33f-4ca7-9d5e-078a87ffb54d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:44.989565 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9eee1c3-f33f-4ca7-9d5e-078a87ffb54d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:44.990028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9eee1c3-f33f-4ca7-9d5e-078a87ffb54d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:44.990450 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9eee1c3-f33f-4ca7-9d5e-078a87ffb54d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:45.127243 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f9eee1c3-f33f-4ca7-9d5e-078a87ffb54d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:45.135910 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f9eee1c3-f33f-4ca7-9d5e-078a87ffb54d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.158750 Aug 04 22:26:45.136467 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 371/736] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:44 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:46.156613 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0e2e7ad7-e055-4df2-8ea1-aaadbc5634e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:46.157229 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0e2e7ad7-e055-4df2-8ea1-aaadbc5634e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:46.163674 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0e2e7ad7-e055-4df2-8ea1-aaadbc5634e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:46.164166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0e2e7ad7-e055-4df2-8ea1-aaadbc5634e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:46.164614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0e2e7ad7-e055-4df2-8ea1-aaadbc5634e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:46.165520 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0e2e7ad7-e055-4df2-8ea1-aaadbc5634e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:46.165986 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0e2e7ad7-e055-4df2-8ea1-aaadbc5634e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:46.166425 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0e2e7ad7-e055-4df2-8ea1-aaadbc5634e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:46.296777 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0e2e7ad7-e055-4df2-8ea1-aaadbc5634e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:46.304620 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0e2e7ad7-e055-4df2-8ea1-aaadbc5634e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.152071 Aug 04 22:26:46.305184 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 366/737] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:46 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:47.326239 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-26014c0f-8b83-4d12-b5bf-79a03bb03fdc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:47.326857 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-26014c0f-8b83-4d12-b5bf-79a03bb03fdc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:47.332849 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26014c0f-8b83-4d12-b5bf-79a03bb03fdc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:47.333334 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26014c0f-8b83-4d12-b5bf-79a03bb03fdc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:47.333797 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26014c0f-8b83-4d12-b5bf-79a03bb03fdc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:47.334506 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26014c0f-8b83-4d12-b5bf-79a03bb03fdc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:47.334955 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26014c0f-8b83-4d12-b5bf-79a03bb03fdc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:47.335373 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26014c0f-8b83-4d12-b5bf-79a03bb03fdc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:47.338922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:47.481934 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-26014c0f-8b83-4d12-b5bf-79a03bb03fdc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:47.490180 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-26014c0f-8b83-4d12-b5bf-79a03bb03fdc tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.168054 Aug 04 22:26:47.490973 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 372/738] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:47 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:48.511732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-64934869-77f4-413b-a3c6-761e1213e433 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:48.512263 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-64934869-77f4-413b-a3c6-761e1213e433 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:48.518671 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-64934869-77f4-413b-a3c6-761e1213e433 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:48.519149 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-64934869-77f4-413b-a3c6-761e1213e433 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:48.519583 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-64934869-77f4-413b-a3c6-761e1213e433 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:48.520299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-64934869-77f4-413b-a3c6-761e1213e433 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:48.520755 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-64934869-77f4-413b-a3c6-761e1213e433 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:48.521281 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-64934869-77f4-413b-a3c6-761e1213e433 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:48.652181 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-64934869-77f4-413b-a3c6-761e1213e433 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:48.660078 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-64934869-77f4-413b-a3c6-761e1213e433 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.152760 Aug 04 22:26:48.660644 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 367/739] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:48 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:49.682762 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c3f5d2af-2cc5-4693-9783-5de03ad37184 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:49.683367 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c3f5d2af-2cc5-4693-9783-5de03ad37184 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:49.689486 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c3f5d2af-2cc5-4693-9783-5de03ad37184 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:49.689969 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c3f5d2af-2cc5-4693-9783-5de03ad37184 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:49.690399 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c3f5d2af-2cc5-4693-9783-5de03ad37184 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:49.691077 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c3f5d2af-2cc5-4693-9783-5de03ad37184 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:49.691527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c3f5d2af-2cc5-4693-9783-5de03ad37184 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:49.691943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c3f5d2af-2cc5-4693-9783-5de03ad37184 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:49.820199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c3f5d2af-2cc5-4693-9783-5de03ad37184 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:49.828749 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c3f5d2af-2cc5-4693-9783-5de03ad37184 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.150319 Aug 04 22:26:49.829317 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 373/740] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:49 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:50.849339 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9ba8859c-8375-4c46-afb3-a08e62dfbf22 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:50.849989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9ba8859c-8375-4c46-afb3-a08e62dfbf22 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:50.856670 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9ba8859c-8375-4c46-afb3-a08e62dfbf22 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:50.857153 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9ba8859c-8375-4c46-afb3-a08e62dfbf22 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:50.857625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9ba8859c-8375-4c46-afb3-a08e62dfbf22 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:50.858574 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9ba8859c-8375-4c46-afb3-a08e62dfbf22 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:50.859028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9ba8859c-8375-4c46-afb3-a08e62dfbf22 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:50.859453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9ba8859c-8375-4c46-afb3-a08e62dfbf22 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:50.990480 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9ba8859c-8375-4c46-afb3-a08e62dfbf22 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:50.993292 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:51.000672 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9ba8859c-8375-4c46-afb3-a08e62dfbf22 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.155187 Aug 04 22:26:51.001237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 368/741] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:50 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:52.022122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-813a68f3-badd-4b36-bcfa-d6188a378689 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:52.022742 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-813a68f3-badd-4b36-bcfa-d6188a378689 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:52.029570 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-813a68f3-badd-4b36-bcfa-d6188a378689 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:52.030064 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-813a68f3-badd-4b36-bcfa-d6188a378689 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:52.030507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-813a68f3-badd-4b36-bcfa-d6188a378689 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:52.031236 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-813a68f3-badd-4b36-bcfa-d6188a378689 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:52.031701 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-813a68f3-badd-4b36-bcfa-d6188a378689 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:52.032133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-813a68f3-badd-4b36-bcfa-d6188a378689 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:52.166288 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-813a68f3-badd-4b36-bcfa-d6188a378689 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:52.174128 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-813a68f3-badd-4b36-bcfa-d6188a378689 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.156426 Aug 04 22:26:52.174697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 374/742] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:52 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:53.196676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-056706fb-27c5-46c6-b049-23813b2135b7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:53.197230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-056706fb-27c5-46c6-b049-23813b2135b7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:53.204682 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-056706fb-27c5-46c6-b049-23813b2135b7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:53.205167 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-056706fb-27c5-46c6-b049-23813b2135b7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:53.205635 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-056706fb-27c5-46c6-b049-23813b2135b7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:53.206324 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-056706fb-27c5-46c6-b049-23813b2135b7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:53.206777 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-056706fb-27c5-46c6-b049-23813b2135b7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:53.207201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-056706fb-27c5-46c6-b049-23813b2135b7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:53.339525 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-056706fb-27c5-46c6-b049-23813b2135b7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:53.347355 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-056706fb-27c5-46c6-b049-23813b2135b7 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.155207 Aug 04 22:26:53.347929 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 369/743] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:53 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:54.369389 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-aa8acbd7-a977-4342-804e-b06707f1bf4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:54.370154 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-aa8acbd7-a977-4342-804e-b06707f1bf4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:54.376166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aa8acbd7-a977-4342-804e-b06707f1bf4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:54.376702 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aa8acbd7-a977-4342-804e-b06707f1bf4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:54.377140 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aa8acbd7-a977-4342-804e-b06707f1bf4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:54.377860 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aa8acbd7-a977-4342-804e-b06707f1bf4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:54.378315 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aa8acbd7-a977-4342-804e-b06707f1bf4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:54.378744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-aa8acbd7-a977-4342-804e-b06707f1bf4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:54.510683 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-aa8acbd7-a977-4342-804e-b06707f1bf4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:54.518982 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-aa8acbd7-a977-4342-804e-b06707f1bf4b tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.153772 Aug 04 22:26:54.519496 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 375/744] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:54 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:55.540680 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-41ff8c01-894d-4764-ba4c-ecd65fed6eab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:55.541196 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-41ff8c01-894d-4764-ba4c-ecd65fed6eab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:55.547620 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-41ff8c01-894d-4764-ba4c-ecd65fed6eab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:55.548097 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-41ff8c01-894d-4764-ba4c-ecd65fed6eab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:55.548530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-41ff8c01-894d-4764-ba4c-ecd65fed6eab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:55.549214 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-41ff8c01-894d-4764-ba4c-ecd65fed6eab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:55.549699 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-41ff8c01-894d-4764-ba4c-ecd65fed6eab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:55.550125 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-41ff8c01-894d-4764-ba4c-ecd65fed6eab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:55.676176 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-41ff8c01-894d-4764-ba4c-ecd65fed6eab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:55.684493 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-41ff8c01-894d-4764-ba4c-ecd65fed6eab tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.148392 Aug 04 22:26:55.685065 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 370/745] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:55 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:56.705591 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e6781b06-931d-468b-a6bd-a96fd10d0a6e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:56.706204 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e6781b06-931d-468b-a6bd-a96fd10d0a6e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:56.708033 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=46 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:56.713824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e6781b06-931d-468b-a6bd-a96fd10d0a6e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:56.714312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e6781b06-931d-468b-a6bd-a96fd10d0a6e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:56.714749 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e6781b06-931d-468b-a6bd-a96fd10d0a6e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:56.715442 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e6781b06-931d-468b-a6bd-a96fd10d0a6e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:56.715897 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e6781b06-931d-468b-a6bd-a96fd10d0a6e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:56.716324 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e6781b06-931d-468b-a6bd-a96fd10d0a6e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:56.846458 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e6781b06-931d-468b-a6bd-a96fd10d0a6e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:56.854813 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e6781b06-931d-468b-a6bd-a96fd10d0a6e tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.153107 Aug 04 22:26:56.855384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 376/746] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:56 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:57.441576 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:26:57.441769 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Thu Aug 4 22:26:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:26:57.876055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-742b9dd9-dd7f-49fb-8256-3b797158f822 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:57.876673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-742b9dd9-dd7f-49fb-8256-3b797158f822 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:57.883144 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-742b9dd9-dd7f-49fb-8256-3b797158f822 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:57.883625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-742b9dd9-dd7f-49fb-8256-3b797158f822 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:57.884058 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-742b9dd9-dd7f-49fb-8256-3b797158f822 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:57.884740 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-742b9dd9-dd7f-49fb-8256-3b797158f822 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:57.885196 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-742b9dd9-dd7f-49fb-8256-3b797158f822 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:57.886181 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-742b9dd9-dd7f-49fb-8256-3b797158f822 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:58.017878 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-742b9dd9-dd7f-49fb-8256-3b797158f822 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:58.026558 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-742b9dd9-dd7f-49fb-8256-3b797158f822 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.153732 Aug 04 22:26:58.027268 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 371/747] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:57 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:26:59.048292 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-feacbf69-71b2-4754-902a-e72a9688feaf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:26:59.048905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-feacbf69-71b2-4754-902a-e72a9688feaf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:26:59.055028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-feacbf69-71b2-4754-902a-e72a9688feaf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:59.055514 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-feacbf69-71b2-4754-902a-e72a9688feaf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:59.055951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-feacbf69-71b2-4754-902a-e72a9688feaf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:59.056647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-feacbf69-71b2-4754-902a-e72a9688feaf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:26:59.057766 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-feacbf69-71b2-4754-902a-e72a9688feaf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:26:59.058307 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-feacbf69-71b2-4754-902a-e72a9688feaf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:26:59.190427 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-feacbf69-71b2-4754-902a-e72a9688feaf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:26:59.198850 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-feacbf69-71b2-4754-902a-e72a9688feaf tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.154385 Aug 04 22:26:59.199411 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 377/748] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:26:59 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:27:00.221227 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b3433ee8-abcb-45e5-8e3d-de377e9b82c1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:00.221873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b3433ee8-abcb-45e5-8e3d-de377e9b82c1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:00.228325 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3433ee8-abcb-45e5-8e3d-de377e9b82c1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:00.229453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3433ee8-abcb-45e5-8e3d-de377e9b82c1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:00.229894 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3433ee8-abcb-45e5-8e3d-de377e9b82c1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:00.230589 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3433ee8-abcb-45e5-8e3d-de377e9b82c1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:00.231044 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3433ee8-abcb-45e5-8e3d-de377e9b82c1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:00.231471 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3433ee8-abcb-45e5-8e3d-de377e9b82c1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:00.364644 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b3433ee8-abcb-45e5-8e3d-de377e9b82c1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:00.373076 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b3433ee8-abcb-45e5-8e3d-de377e9b82c1 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.155936 Aug 04 22:27:00.373861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 372/749] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:00 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:27:01.395850 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-5b8fbe0c-0a0b-40da-a619-f21f72b2b738 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:01.396490 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-5b8fbe0c-0a0b-40da-a619-f21f72b2b738 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:01.403505 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5b8fbe0c-0a0b-40da-a619-f21f72b2b738 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:01.403985 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5b8fbe0c-0a0b-40da-a619-f21f72b2b738 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:01.404412 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5b8fbe0c-0a0b-40da-a619-f21f72b2b738 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:01.405126 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5b8fbe0c-0a0b-40da-a619-f21f72b2b738 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:01.405607 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5b8fbe0c-0a0b-40da-a619-f21f72b2b738 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:01.406025 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5b8fbe0c-0a0b-40da-a619-f21f72b2b738 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:01.545650 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-5b8fbe0c-0a0b-40da-a619-f21f72b2b738 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:01.553586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-5b8fbe0c-0a0b-40da-a619-f21f72b2b738 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.161600 Aug 04 22:27:01.554151 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 378/750] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:01 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:27:02.574275 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-77107977-385e-4737-bd9d-71f532d35785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:02.574886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-77107977-385e-4737-bd9d-71f532d35785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:02.577182 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=34 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:02.585370 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-77107977-385e-4737-bd9d-71f532d35785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:02.585895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-77107977-385e-4737-bd9d-71f532d35785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:02.586338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-77107977-385e-4737-bd9d-71f532d35785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:02.587041 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-77107977-385e-4737-bd9d-71f532d35785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:02.587496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-77107977-385e-4737-bd9d-71f532d35785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:02.587957 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-77107977-385e-4737-bd9d-71f532d35785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:02.722555 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-77107977-385e-4737-bd9d-71f532d35785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:02.731728 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-77107977-385e-4737-bd9d-71f532d35785 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.161373 Aug 04 22:27:02.732299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 373/751] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:02 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:27:03.665633 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c560b107-3e25-46cb-8c2b-7c34c1f495c3 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:03.666997 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c560b107-3e25-46cb-8c2b-7c34c1f495c3 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:03.672559 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c560b107-3e25-46cb-8c2b-7c34c1f495c3 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:03.673045 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c560b107-3e25-46cb-8c2b-7c34c1f495c3 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:03.673509 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c560b107-3e25-46cb-8c2b-7c34c1f495c3 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:03.674199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c560b107-3e25-46cb-8c2b-7c34c1f495c3 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:03.674658 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c560b107-3e25-46cb-8c2b-7c34c1f495c3 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:03.675081 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c560b107-3e25-46cb-8c2b-7c34c1f495c3 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:03.753444 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-26e9a601-8c67-478a-b2cc-42419ea3fefd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:03.754087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-26e9a601-8c67-478a-b2cc-42419ea3fefd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:03.760435 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-26e9a601-8c67-478a-b2cc-42419ea3fefd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:03.760922 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-26e9a601-8c67-478a-b2cc-42419ea3fefd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:03.761359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-26e9a601-8c67-478a-b2cc-42419ea3fefd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:03.762094 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-26e9a601-8c67-478a-b2cc-42419ea3fefd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:03.762550 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-26e9a601-8c67-478a-b2cc-42419ea3fefd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:03.762981 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-26e9a601-8c67-478a-b2cc-42419ea3fefd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:03.797544 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.objects.instance [None req-c560b107-3e25-46cb-8c2b-7c34c1f495c3 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lazy-loading 'services' on Instance uuid 17abd746-07d4-49ed-a0bb-05eedb87a27b {{(pid=129197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:27:03.882104 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:27:03.882295 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Thu Aug 4 22:27:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b/os-volume_attachments/90308e90-3a5b-4788-83f2-811fbadba73c (ip 10.222.0.109) !!! Aug 04 22:27:03.896704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-26e9a601-8c67-478a-b2cc-42419ea3fefd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:03.906364 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-26e9a601-8c67-478a-b2cc-42419ea3fefd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1739 microversion: 2.1 time: 0.156643 Aug 04 22:27:03.906935 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 374/752] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:03 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:27:03.922674 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c560b107-3e25-46cb-8c2b-7c34c1f495c3 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "DELETE /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b/os-volume_attachments/90308e90-3a5b-4788-83f2-811fbadba73c" status: 202 len: 0 microversion: 2.1 time: 0.260734 Aug 04 22:27:03.923504 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 379/753] 10.222.0.109 () {58 vars in 1421 bytes} [Thu Aug 4 22:27:03 2022] DELETE /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b/os-volume_attachments/90308e90-3a5b-4788-83f2-811fbadba73c => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:27:04.930743 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-089ccb8f-5d45-4207-85e0-fa027ed8cf0d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:04.931360 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-089ccb8f-5d45-4207-85e0-fa027ed8cf0d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:04.938817 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-089ccb8f-5d45-4207-85e0-fa027ed8cf0d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:04.939308 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-089ccb8f-5d45-4207-85e0-fa027ed8cf0d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:04.939746 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-089ccb8f-5d45-4207-85e0-fa027ed8cf0d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:04.940441 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-089ccb8f-5d45-4207-85e0-fa027ed8cf0d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:04.940898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-089ccb8f-5d45-4207-85e0-fa027ed8cf0d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:04.941327 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-089ccb8f-5d45-4207-85e0-fa027ed8cf0d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:05.071287 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-089ccb8f-5d45-4207-85e0-fa027ed8cf0d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:05.079401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-089ccb8f-5d45-4207-85e0-fa027ed8cf0d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1719 microversion: 2.1 time: 0.152473 Aug 04 22:27:05.079974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 375/754] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:04 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:27:05.140156 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d7e08eaa-77a3-41a8-b3f6-0ff72e5dbfc3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:05.140893 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d7e08eaa-77a3-41a8-b3f6-0ff72e5dbfc3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:05.147579 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d7e08eaa-77a3-41a8-b3f6-0ff72e5dbfc3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:05.148072 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d7e08eaa-77a3-41a8-b3f6-0ff72e5dbfc3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:05.148512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d7e08eaa-77a3-41a8-b3f6-0ff72e5dbfc3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:05.149208 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d7e08eaa-77a3-41a8-b3f6-0ff72e5dbfc3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:05.149698 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d7e08eaa-77a3-41a8-b3f6-0ff72e5dbfc3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:05.150127 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d7e08eaa-77a3-41a8-b3f6-0ff72e5dbfc3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:05.237725 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-d7e08eaa-77a3-41a8-b3f6-0ff72e5dbfc3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] HTTP exception thrown: Cannot 'detach_volume' instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb while it is in vm_state rescued Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d7e08eaa-77a3-41a8-b3f6-0ff72e5dbfc3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Request method failure captured: Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: DELETE /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-volume_attachments/e569f8d1-1b78-469c-a193-f3c2426d680f HTTP/1.1 Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYrBl6iVSsbeUBGuNUsCrcR_k9iol3MjGtflczYOd1VVWaNljGEka8fyS_szpgwEG027Pb-gXKzAyoPcqSTNny01b2nKUjZVmNL3L-UuiR2ay4JqGJewr8wM744kJa6rrGR2Z06pY_jnaOVvdsETxhEF674NYDOdgIbxMjU0W1UhHg Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 5116986e2edc4b5c92da0b77a497910a Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:27:05.239368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:27:05.240950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/5116986e2edc4b5c92da0b77a497910a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_5116986e2edc4b5c92da0b77a497910a", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/5116986e2edc4b5c92da0b77a497910a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/5116986e2edc4b5c92da0b77a497910a"}]}] Aug 04 22:27:05.240950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:27:05.240950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 5116986e2edc4b5c92da0b77a497910a Aug 04 22:27:05.240950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:27:05.240950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-ServerRescueNegativeTestJSON-1760242217-project Aug 04 22:27:05.240950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:27:05.240950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:27:05.240950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: f3dab07011da408c97ed90d58f2c155b Aug 04 22:27:05.240950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1760242217-project Aug 04 22:27:05.240950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:27:05.240950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Cannot 'detach_volume' instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb while it is in vm_state rescued Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'server_id': '5cca04a9-f894-43cf-b1d6-009292cdbcbb', 'id': 'e569f8d1-1b78-469c-a193-f3c2426d680f'} Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:27:05.241753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb while it is in vm_state rescued Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb while it is in vm_state rescued Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:27:05.242968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d7e08eaa-77a3-41a8-b3f6-0ff72e5dbfc3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Returning 409 to user: Cannot 'detach_volume' instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb while it is in vm_state rescued {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:27:05.243930 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d7e08eaa-77a3-41a8-b3f6-0ff72e5dbfc3 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "DELETE /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-volume_attachments/e569f8d1-1b78-469c-a193-f3c2426d680f" status: 409 len: 152 microversion: 2.1 time: 0.105177 Aug 04 22:27:05.243930 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 380/755] 10.222.0.109 () {58 vars in 1421 bytes} [Thu Aug 4 22:27:05 2022] DELETE /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-volume_attachments/e569f8d1-1b78-469c-a193-f3c2426d680f => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 22:27:05.250700 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-19be0d5c-935e-49c0-ae52-00ac06a8c528 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:27:05.251234 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-19be0d5c-935e-49c0-ae52-00ac06a8c528 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:05.257002 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19be0d5c-935e-49c0-ae52-00ac06a8c528 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:05.257510 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19be0d5c-935e-49c0-ae52-00ac06a8c528 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:05.257944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19be0d5c-935e-49c0-ae52-00ac06a8c528 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:05.258623 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19be0d5c-935e-49c0-ae52-00ac06a8c528 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:05.259072 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19be0d5c-935e-49c0-ae52-00ac06a8c528 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:05.259488 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-19be0d5c-935e-49c0-ae52-00ac06a8c528 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:05.332188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-19be0d5c-935e-49c0-ae52-00ac06a8c528 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "POST /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/action" status: 202 len: 0 microversion: 2.1 time: 0.084748 Aug 04 22:27:05.336326 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 376/756] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:27:05 2022] POST /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:27:05.341119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2cf6b053-14d7-478e-8e73-8661ee077397 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:05.341748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2cf6b053-14d7-478e-8e73-8661ee077397 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:05.347670 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2cf6b053-14d7-478e-8e73-8661ee077397 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:05.348149 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2cf6b053-14d7-478e-8e73-8661ee077397 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:05.348572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2cf6b053-14d7-478e-8e73-8661ee077397 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:05.349252 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2cf6b053-14d7-478e-8e73-8661ee077397 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:05.349720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2cf6b053-14d7-478e-8e73-8661ee077397 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:05.350134 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2cf6b053-14d7-478e-8e73-8661ee077397 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:05.484201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2cf6b053-14d7-478e-8e73-8661ee077397 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:05.497861 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2cf6b053-14d7-478e-8e73-8661ee077397 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1727 microversion: 2.1 time: 0.160210 Aug 04 22:27:05.498632 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 381/757] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:05 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:27:06.105006 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3488bfb5-81ce-4773-9d49-02ed94483954 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:06.105693 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3488bfb5-81ce-4773-9d49-02ed94483954 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:06.112308 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3488bfb5-81ce-4773-9d49-02ed94483954 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:06.112775 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3488bfb5-81ce-4773-9d49-02ed94483954 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:06.113202 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3488bfb5-81ce-4773-9d49-02ed94483954 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:06.113916 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3488bfb5-81ce-4773-9d49-02ed94483954 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:06.114361 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3488bfb5-81ce-4773-9d49-02ed94483954 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:06.114776 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3488bfb5-81ce-4773-9d49-02ed94483954 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:06.139451 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3488bfb5-81ce-4773-9d49-02ed94483954 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Going to try to terminate instance {{(pid=129196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:27:06.212316 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3488bfb5-81ce-4773-9d49-02ed94483954 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "DELETE /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 204 len: 0 microversion: 2.1 time: 0.112269 Aug 04 22:27:06.213577 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 377/758] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:27:06 2022] DELETE /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:27:06.221975 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a162ab3a-87ed-493c-a421-f358384545ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:06.222636 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a162ab3a-87ed-493c-a421-f358384545ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:06.229363 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a162ab3a-87ed-493c-a421-f358384545ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:06.229890 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a162ab3a-87ed-493c-a421-f358384545ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:06.230335 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a162ab3a-87ed-493c-a421-f358384545ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:06.231035 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a162ab3a-87ed-493c-a421-f358384545ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:06.231504 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a162ab3a-87ed-493c-a421-f358384545ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:06.231913 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a162ab3a-87ed-493c-a421-f358384545ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:06.366407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a162ab3a-87ed-493c-a421-f358384545ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:06.373891 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a162ab3a-87ed-493c-a421-f358384545ba tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1518 microversion: 2.1 time: 0.155829 Aug 04 22:27:06.374452 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 382/759] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:06 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:27:06.520811 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-907194c1-2da1-4042-b427-9eb062dc6e72 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:06.521509 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-907194c1-2da1-4042-b427-9eb062dc6e72 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:06.528082 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-907194c1-2da1-4042-b427-9eb062dc6e72 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:06.528557 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-907194c1-2da1-4042-b427-9eb062dc6e72 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:06.528983 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-907194c1-2da1-4042-b427-9eb062dc6e72 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:06.529699 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-907194c1-2da1-4042-b427-9eb062dc6e72 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:06.530145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-907194c1-2da1-4042-b427-9eb062dc6e72 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:06.530569 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-907194c1-2da1-4042-b427-9eb062dc6e72 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:06.895593 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-907194c1-2da1-4042-b427-9eb062dc6e72 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:06.903547 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-907194c1-2da1-4042-b427-9eb062dc6e72 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1727 microversion: 2.1 time: 0.386964 Aug 04 22:27:06.904109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 378/760] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:06 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1727 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:27:07.394930 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e4db81fe-116c-43ed-81c0-7ff4cd4484cb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:07.395484 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e4db81fe-116c-43ed-81c0-7ff4cd4484cb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:07.401423 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e4db81fe-116c-43ed-81c0-7ff4cd4484cb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:07.401997 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e4db81fe-116c-43ed-81c0-7ff4cd4484cb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:07.402456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e4db81fe-116c-43ed-81c0-7ff4cd4484cb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:07.403173 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e4db81fe-116c-43ed-81c0-7ff4cd4484cb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:07.403629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e4db81fe-116c-43ed-81c0-7ff4cd4484cb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:07.404056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e4db81fe-116c-43ed-81c0-7ff4cd4484cb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:07.531135 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e4db81fe-116c-43ed-81c0-7ff4cd4484cb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:07.538604 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e4db81fe-116c-43ed-81c0-7ff4cd4484cb tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1518 microversion: 2.1 time: 0.147597 Aug 04 22:27:07.539173 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 383/761] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:07 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:27:07.924958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-28ff9d57-85ca-4645-a2ce-d2b3f8d2560a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:07.925593 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-28ff9d57-85ca-4645-a2ce-d2b3f8d2560a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:07.932030 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-28ff9d57-85ca-4645-a2ce-d2b3f8d2560a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:07.932506 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-28ff9d57-85ca-4645-a2ce-d2b3f8d2560a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:07.932933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-28ff9d57-85ca-4645-a2ce-d2b3f8d2560a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:07.933727 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-28ff9d57-85ca-4645-a2ce-d2b3f8d2560a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:07.934209 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-28ff9d57-85ca-4645-a2ce-d2b3f8d2560a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:07.934511 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-28ff9d57-85ca-4645-a2ce-d2b3f8d2560a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:08.060281 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-28ff9d57-85ca-4645-a2ce-d2b3f8d2560a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:08.068226 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-28ff9d57-85ca-4645-a2ce-d2b3f8d2560a tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1727 microversion: 2.1 time: 0.147332 Aug 04 22:27:08.068789 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 379/762] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:07 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:27:08.560752 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-933188b0-a03d-4df0-bffe-44fbb473c606 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:08.561365 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-933188b0-a03d-4df0-bffe-44fbb473c606 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:08.567300 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-933188b0-a03d-4df0-bffe-44fbb473c606 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:08.567788 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-933188b0-a03d-4df0-bffe-44fbb473c606 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:08.568227 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-933188b0-a03d-4df0-bffe-44fbb473c606 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:08.568922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-933188b0-a03d-4df0-bffe-44fbb473c606 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:08.569382 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-933188b0-a03d-4df0-bffe-44fbb473c606 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:08.569837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-933188b0-a03d-4df0-bffe-44fbb473c606 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:08.695521 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-933188b0-a03d-4df0-bffe-44fbb473c606 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:08.703946 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-933188b0-a03d-4df0-bffe-44fbb473c606 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1518 microversion: 2.1 time: 0.147643 Aug 04 22:27:08.704512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 384/763] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:08 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:27:09.089357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-54db2c49-762a-494a-aa92-6c4bdd7afde0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:09.090054 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-54db2c49-762a-494a-aa92-6c4bdd7afde0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:09.096405 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-54db2c49-762a-494a-aa92-6c4bdd7afde0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:09.096888 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-54db2c49-762a-494a-aa92-6c4bdd7afde0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:09.097320 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-54db2c49-762a-494a-aa92-6c4bdd7afde0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:09.098049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-54db2c49-762a-494a-aa92-6c4bdd7afde0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:09.098505 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-54db2c49-762a-494a-aa92-6c4bdd7afde0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:09.098935 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-54db2c49-762a-494a-aa92-6c4bdd7afde0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:09.241977 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-54db2c49-762a-494a-aa92-6c4bdd7afde0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:09.251333 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-54db2c49-762a-494a-aa92-6c4bdd7afde0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1727 microversion: 2.1 time: 0.165754 Aug 04 22:27:09.251944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 380/764] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:09 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:27:09.724976 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b0418215-c117-4403-bf39-91a7b3af9a9f tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:09.725627 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b0418215-c117-4403-bf39-91a7b3af9a9f tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:09.731769 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b0418215-c117-4403-bf39-91a7b3af9a9f tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:09.732254 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b0418215-c117-4403-bf39-91a7b3af9a9f tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:09.732943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b0418215-c117-4403-bf39-91a7b3af9a9f tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:09.733667 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b0418215-c117-4403-bf39-91a7b3af9a9f tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:09.734128 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b0418215-c117-4403-bf39-91a7b3af9a9f tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:09.734555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b0418215-c117-4403-bf39-91a7b3af9a9f tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:09.872945 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b0418215-c117-4403-bf39-91a7b3af9a9f tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:09.880936 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b0418215-c117-4403-bf39-91a7b3af9a9f tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1518 microversion: 2.1 time: 0.159855 Aug 04 22:27:09.881532 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 385/765] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:09 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:27:10.272081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c70f1f2c-c8d3-45c8-a5a1-9ea91cca1346 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:10.272725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c70f1f2c-c8d3-45c8-a5a1-9ea91cca1346 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:10.279230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c70f1f2c-c8d3-45c8-a5a1-9ea91cca1346 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:10.279712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c70f1f2c-c8d3-45c8-a5a1-9ea91cca1346 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:10.280147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c70f1f2c-c8d3-45c8-a5a1-9ea91cca1346 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:10.280839 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c70f1f2c-c8d3-45c8-a5a1-9ea91cca1346 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:10.281314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c70f1f2c-c8d3-45c8-a5a1-9ea91cca1346 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:10.281747 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c70f1f2c-c8d3-45c8-a5a1-9ea91cca1346 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:10.409954 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c70f1f2c-c8d3-45c8-a5a1-9ea91cca1346 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:10.418362 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c70f1f2c-c8d3-45c8-a5a1-9ea91cca1346 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1727 microversion: 2.1 time: 0.149584 Aug 04 22:27:10.418935 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 381/766] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:10 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:27:10.860721 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-da414164-d1da-4a89-8ae4-2db40355819b req-ec5d4caf-05b5-4f94-9deb-22994808f960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17abd746-07d4-49ed-a0bb-05eedb87a27b", "name": "network-vif-deleted", "tag": "0641aa55-262e-4c48-b76a-9decd38a0a6d"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:27:10.871082 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-da414164-d1da-4a89-8ae4-2db40355819b req-ec5d4caf-05b5-4f94-9deb-22994808f960 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:10.871587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-da414164-d1da-4a89-8ae4-2db40355819b req-ec5d4caf-05b5-4f94-9deb-22994808f960 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:10.872012 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-da414164-d1da-4a89-8ae4-2db40355819b req-ec5d4caf-05b5-4f94-9deb-22994808f960 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:10.883469 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-da414164-d1da-4a89-8ae4-2db40355819b req-ec5d4caf-05b5-4f94-9deb-22994808f960 service nova] Creating event network-vif-deleted:0641aa55-262e-4c48-b76a-9decd38a0a6d for instance 17abd746-07d4-49ed-a0bb-05eedb87a27b on hv-cinder-85221 Aug 04 22:27:10.888596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-da414164-d1da-4a89-8ae4-2db40355819b req-ec5d4caf-05b5-4f94-9deb-22994808f960 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031744 Aug 04 22:27:10.889175 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 386/767] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:27:10.903338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3b33c803-930b-42a6-951e-89ed86a4c6ea tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:10.903941 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3b33c803-930b-42a6-951e-89ed86a4c6ea tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:10.909914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b33c803-930b-42a6-951e-89ed86a4c6ea tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:10.910375 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b33c803-930b-42a6-951e-89ed86a4c6ea tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:10.910811 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b33c803-930b-42a6-951e-89ed86a4c6ea tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:10.911502 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b33c803-930b-42a6-951e-89ed86a4c6ea tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:10.911954 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b33c803-930b-42a6-951e-89ed86a4c6ea tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:10.912380 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3b33c803-930b-42a6-951e-89ed86a4c6ea tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:10.977138 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3b33c803-930b-42a6-951e-89ed86a4c6ea tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd37f744a5476488afe91d97a406a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260c01e60f5e48ac9420c388a958e0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:10.979759 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:10.988046 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3b33c803-930b-42a6-951e-89ed86a4c6ea tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 200 len: 1476 microversion: 2.1 time: 0.088905 Aug 04 22:27:10.988980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 382/768] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:10 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 1476 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:27:11.440664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-752fbd72-630a-461c-a021-8b8bce4ef5c2 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:11.441367 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-752fbd72-630a-461c-a021-8b8bce4ef5c2 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:11.447442 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-752fbd72-630a-461c-a021-8b8bce4ef5c2 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:11.447932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-752fbd72-630a-461c-a021-8b8bce4ef5c2 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:11.448372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-752fbd72-630a-461c-a021-8b8bce4ef5c2 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:11.449586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-752fbd72-630a-461c-a021-8b8bce4ef5c2 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:11.450055 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-752fbd72-630a-461c-a021-8b8bce4ef5c2 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:11.450577 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-752fbd72-630a-461c-a021-8b8bce4ef5c2 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:11.592718 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-752fbd72-630a-461c-a021-8b8bce4ef5c2 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:27:11.601896 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-752fbd72-630a-461c-a021-8b8bce4ef5c2 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1733 microversion: 2.1 time: 0.165345 Aug 04 22:27:11.602471 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 387/769] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:11 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:27:11.623420 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-33d87f03-0c6f-40c3-9edb-72045977530d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:11.623935 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-33d87f03-0c6f-40c3-9edb-72045977530d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:11.631201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-33d87f03-0c6f-40c3-9edb-72045977530d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:11.631679 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-33d87f03-0c6f-40c3-9edb-72045977530d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:11.632107 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-33d87f03-0c6f-40c3-9edb-72045977530d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:11.632782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-33d87f03-0c6f-40c3-9edb-72045977530d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:11.633226 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-33d87f03-0c6f-40c3-9edb-72045977530d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:11.633677 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-33d87f03-0c6f-40c3-9edb-72045977530d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:11.713643 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-33d87f03-0c6f-40c3-9edb-72045977530d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094663 Aug 04 22:27:11.714245 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 383/770] 10.222.0.109 () {58 vars in 1280 bytes} [Thu Aug 4 22:27:11 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:27:12.008887 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-cf291bf7-84db-45e3-ba34-fe923b53de65 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:12.009511 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-cf291bf7-84db-45e3-ba34-fe923b53de65 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] [instance: 17abd746-07d4-49ed-a0bb-05eedb87a27b] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:12.015630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cf291bf7-84db-45e3-ba34-fe923b53de65 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:12.016123 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cf291bf7-84db-45e3-ba34-fe923b53de65 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:12.016560 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cf291bf7-84db-45e3-ba34-fe923b53de65 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:12.017260 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cf291bf7-84db-45e3-ba34-fe923b53de65 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:12.017757 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cf291bf7-84db-45e3-ba34-fe923b53de65 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:12.018187 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cf291bf7-84db-45e3-ba34-fe923b53de65 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:12.031604 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-cf291bf7-84db-45e3-ba34-fe923b53de65 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] HTTP exception thrown: Instance 17abd746-07d4-49ed-a0bb-05eedb87a27b could not be found. Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-cf291bf7-84db-45e3-ba34-fe923b53de65 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Request method failure captured: Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b HTTP/1.1 Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EcK-xizfYuTztokNxlRmm8RowF8EBsEl8d2OsWA1AoBus5aBZARG7_jgT7aYbJQCVs5TosU9JVdxhbqd9cd5vvGJmByH1omB32ynlqJWswy-vfneJ1erHL13c2tKoHPNEn54yOXjnpD8ev4Zg1zfp09tq5B-mtk5qGP_GEvuYe16Ss Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 260c01e60f5e48ac9420c388a958e0ee Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1299201218 Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:27:12.033247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:27:12.034740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/260c01e60f5e48ac9420c388a958e0ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_260c01e60f5e48ac9420c388a958e0ee", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/260c01e60f5e48ac9420c388a958e0ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/260c01e60f5e48ac9420c388a958e0ee"}]}] Aug 04 22:27:12.034740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-VolumesSnapshotTestJSON-1299201218 Aug 04 22:27:12.034740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 260c01e60f5e48ac9420c388a958e0ee Aug 04 22:27:12.034740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1299201218 Aug 04 22:27:12.034740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-VolumesSnapshotTestJSON-1299201218-project Aug 04 22:27:12.034740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:27:12.034740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:27:12.034740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 91dd37f744a5476488afe91d97a406a1 Aug 04 22:27:12.034740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-VolumesSnapshotTestJSON-1299201218-project Aug 04 22:27:12.034740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:27:12.034740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance 17abd746-07d4-49ed-a0bb-05eedb87a27b could not be found. Aug 04 22:27:12.034740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '17abd746-07d4-49ed-a0bb-05eedb87a27b'} Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17abd746-07d4-49ed-a0bb-05eedb87a27b could not be found. Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:27:12.035499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17abd746-07d4-49ed-a0bb-05eedb87a27b could not be found. Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17abd746-07d4-49ed-a0bb-05eedb87a27b could not be found. Aug 04 22:27:12.036744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:27:12.037945 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-cf291bf7-84db-45e3-ba34-fe923b53de65 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] Returning 404 to user: Instance 17abd746-07d4-49ed-a0bb-05eedb87a27b could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:27:12.037945 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-cf291bf7-84db-45e3-ba34-fe923b53de65 tempest-VolumesSnapshotTestJSON-1299201218 tempest-VolumesSnapshotTestJSON-1299201218-project] 10.222.0.109 "GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b" status: 404 len: 111 microversion: 2.1 time: 0.029767 Aug 04 22:27:12.037945 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 388/771] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:27:12 2022] GET /compute/v2.1/servers/17abd746-07d4-49ed-a0bb-05eedb87a27b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:27:12.654055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-90f8a7ca-5a79-4781-946f-70cb7eefe809 req-1b52deca-4b89-48eb-9662-a76d91785eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cca04a9-f894-43cf-b1d6-009292cdbcbb", "tag": "12d64262-0acf-4b1f-8905-8c5d540e11ec"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:27:12.663401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-90f8a7ca-5a79-4781-946f-70cb7eefe809 req-1b52deca-4b89-48eb-9662-a76d91785eaf service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:12.663886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-90f8a7ca-5a79-4781-946f-70cb7eefe809 req-1b52deca-4b89-48eb-9662-a76d91785eaf service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:12.664319 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-90f8a7ca-5a79-4781-946f-70cb7eefe809 req-1b52deca-4b89-48eb-9662-a76d91785eaf service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:12.676151 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-90f8a7ca-5a79-4781-946f-70cb7eefe809 req-1b52deca-4b89-48eb-9662-a76d91785eaf service nova] Creating event network-changed:12d64262-0acf-4b1f-8905-8c5d540e11ec for instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb on hv-cinder-85221 Aug 04 22:27:12.681335 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-90f8a7ca-5a79-4781-946f-70cb7eefe809 req-1b52deca-4b89-48eb-9662-a76d91785eaf service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091011 Aug 04 22:27:12.681970 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 384/772] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:27:14.696447 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-2a85aeee-4a66-4cf4-815d-7220ebc317e1 req-d940a1e7-f7a5-4550-90a3-6f7a095ec1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cca04a9-f894-43cf-b1d6-009292cdbcbb", "tag": "12d64262-0acf-4b1f-8905-8c5d540e11ec"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:27:14.705701 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-2a85aeee-4a66-4cf4-815d-7220ebc317e1 req-d940a1e7-f7a5-4550-90a3-6f7a095ec1e7 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:14.706184 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-2a85aeee-4a66-4cf4-815d-7220ebc317e1 req-d940a1e7-f7a5-4550-90a3-6f7a095ec1e7 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:14.706620 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-2a85aeee-4a66-4cf4-815d-7220ebc317e1 req-d940a1e7-f7a5-4550-90a3-6f7a095ec1e7 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:14.717921 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-2a85aeee-4a66-4cf4-815d-7220ebc317e1 req-d940a1e7-f7a5-4550-90a3-6f7a095ec1e7 service nova] Creating event network-changed:12d64262-0acf-4b1f-8905-8c5d540e11ec for instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb on hv-cinder-85221 Aug 04 22:27:14.723091 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-2a85aeee-4a66-4cf4-815d-7220ebc317e1 req-d940a1e7-f7a5-4550-90a3-6f7a095ec1e7 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030245 Aug 04 22:27:14.723769 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 389/773] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:27:49.228155 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:49.230114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=7 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:49.438556 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-dac45598-6470-4c57-bfa5-d704ca998736 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Action: 'create', calling method: .version_select at 0x7fe7b2047790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1619943125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsVNxGbU4OiYXruIMglQwOHohOeQnvgrSex0nX5DkiwVLS0QzYFDg4uyBirxOYoTF+nPE2bLfE6ky1r1FxWQSbq7o/AxNMkYEWlVXNvEQBBnknb0duMnG4aBPFhjV3wRw=="}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:27:49.456359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-dac45598-6470-4c57-bfa5-d704ca998736 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Getting quotas for project 5bff3367439f45a7b7a420b66dd8574a. Resources: {'key_pairs'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:27:49.460548 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-dac45598-6470-4c57-bfa5-d704ca998736 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Getting quotas for user aaa106f1923b43dcb4ca4973815108c0 and project 5bff3367439f45a7b7a420b66dd8574a. Resources: {'key_pairs'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:27:49.486727 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-dac45598-6470-4c57-bfa5-d704ca998736 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.264685 Aug 04 22:27:49.487743 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 385/774] 10.222.0.109 () {60 vars in 1164 bytes} [Thu Aug 4 22:27:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:27:59.822752 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-540efa75-647a-4d3a-8489-461d8c569ce1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:59.823423 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-540efa75-647a-4d3a-8489-461d8c569ce1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:59.825502 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=27 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:59.827119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:59.833185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-540efa75-647a-4d3a-8489-461d8c569ce1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:59.833703 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-540efa75-647a-4d3a-8489-461d8c569ce1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:59.834146 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-540efa75-647a-4d3a-8489-461d8c569ce1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:59.834852 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-540efa75-647a-4d3a-8489-461d8c569ce1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:59.835313 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-540efa75-647a-4d3a-8489-461d8c569ce1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:59.835741 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-540efa75-647a-4d3a-8489-461d8c569ce1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:59.865109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-540efa75-647a-4d3a-8489-461d8c569ce1 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-volume_attachments/75b2d564-c119-45e5-b893-c3db69ca45d5" status: 200 len: 194 microversion: 2.20 time: 0.046671 Aug 04 22:27:59.865728 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 390/775] 10.222.0.109 () {60 vars in 1459 bytes} [Thu Aug 4 22:27:59 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-volume_attachments/75b2d564-c119-45e5-b893-c3db69ca45d5 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:27:59.937199 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-cf98eb50-5c99-4ae0-89b2-53faa2b1e76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:27:59.937838 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-cf98eb50-5c99-4ae0-89b2-53faa2b1e76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:27:59.939783 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=4 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:59.940423 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:59.946598 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cf98eb50-5c99-4ae0-89b2-53faa2b1e76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:59.947088 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cf98eb50-5c99-4ae0-89b2-53faa2b1e76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:59.947529 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cf98eb50-5c99-4ae0-89b2-53faa2b1e76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:27:59.948231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cf98eb50-5c99-4ae0-89b2-53faa2b1e76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:27:59.948684 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cf98eb50-5c99-4ae0-89b2-53faa2b1e76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:27:59.949112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cf98eb50-5c99-4ae0-89b2-53faa2b1e76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:00.032870 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-cf98eb50-5c99-4ae0-89b2-53faa2b1e76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lazy-loading 'services' on Instance uuid eb440660-4715-48f6-a7ff-f0b74dfefe21 {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:28:00.104685 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-cf98eb50-5c99-4ae0-89b2-53faa2b1e76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "DELETE /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-volume_attachments/75b2d564-c119-45e5-b893-c3db69ca45d5" status: 202 len: 0 microversion: 2.20 time: 0.171518 Aug 04 22:28:00.109631 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 386/776] 10.222.0.109 () {60 vars in 1462 bytes} [Thu Aug 4 22:27:59 2022] DELETE /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-volume_attachments/75b2d564-c119-45e5-b893-c3db69ca45d5 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:28:00.115977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-78cfc518-7c5b-4bff-9d34-cf5be3cd1ae9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:00.118183 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-78cfc518-7c5b-4bff-9d34-cf5be3cd1ae9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:00.125122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78cfc518-7c5b-4bff-9d34-cf5be3cd1ae9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:00.125721 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78cfc518-7c5b-4bff-9d34-cf5be3cd1ae9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:00.126183 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78cfc518-7c5b-4bff-9d34-cf5be3cd1ae9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:00.126897 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78cfc518-7c5b-4bff-9d34-cf5be3cd1ae9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:00.127388 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78cfc518-7c5b-4bff-9d34-cf5be3cd1ae9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:00.127847 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78cfc518-7c5b-4bff-9d34-cf5be3cd1ae9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:00.160990 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-78cfc518-7c5b-4bff-9d34-cf5be3cd1ae9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050289 Aug 04 22:28:00.161596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 391/777] 10.222.0.109 () {60 vars in 1348 bytes} [Thu Aug 4 22:28:00 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 22:28:01.174938 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c526f7d5-18ef-4d67-8dd9-67882b1465fb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:01.177073 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c526f7d5-18ef-4d67-8dd9-67882b1465fb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:01.183187 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c526f7d5-18ef-4d67-8dd9-67882b1465fb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:01.183684 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c526f7d5-18ef-4d67-8dd9-67882b1465fb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:01.184106 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c526f7d5-18ef-4d67-8dd9-67882b1465fb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:01.184795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c526f7d5-18ef-4d67-8dd9-67882b1465fb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:01.185249 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c526f7d5-18ef-4d67-8dd9-67882b1465fb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:01.185704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c526f7d5-18ef-4d67-8dd9-67882b1465fb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:01.215507 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c526f7d5-18ef-4d67-8dd9-67882b1465fb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045606 Aug 04 22:28:01.216184 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 387/778] 10.222.0.109 () {60 vars in 1348 bytes} [Thu Aug 4 22:28:01 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:28:02.228283 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6cdc853f-b906-465e-a673-de04b8295478 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:02.230607 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6cdc853f-b906-465e-a673-de04b8295478 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:02.236588 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6cdc853f-b906-465e-a673-de04b8295478 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:02.237062 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6cdc853f-b906-465e-a673-de04b8295478 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:02.237526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6cdc853f-b906-465e-a673-de04b8295478 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:02.238209 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6cdc853f-b906-465e-a673-de04b8295478 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:02.238657 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6cdc853f-b906-465e-a673-de04b8295478 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:02.239076 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6cdc853f-b906-465e-a673-de04b8295478 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:02.268210 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6cdc853f-b906-465e-a673-de04b8295478 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043909 Aug 04 22:28:02.268959 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 392/779] 10.222.0.109 () {60 vars in 1348 bytes} [Thu Aug 4 22:28:02 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:02.331377 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-06579b12-f09c-4317-8eb3-0b354d61e899 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:02.332031 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-06579b12-f09c-4317-8eb3-0b354d61e899 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:02.338367 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-06579b12-f09c-4317-8eb3-0b354d61e899 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:02.338846 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-06579b12-f09c-4317-8eb3-0b354d61e899 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:02.339282 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-06579b12-f09c-4317-8eb3-0b354d61e899 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:02.339963 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-06579b12-f09c-4317-8eb3-0b354d61e899 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:02.340408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-06579b12-f09c-4317-8eb3-0b354d61e899 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:02.340825 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-06579b12-f09c-4317-8eb3-0b354d61e899 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:02.366089 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-06579b12-f09c-4317-8eb3-0b354d61e899 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Going to try to terminate instance {{(pid=129196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:28:02.441850 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-06579b12-f09c-4317-8eb3-0b354d61e899 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "DELETE /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 204 len: 0 microversion: 2.20 time: 0.114818 Aug 04 22:28:02.442636 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 388/780] 10.222.0.109 () {60 vars in 1285 bytes} [Thu Aug 4 22:28:02 2022] DELETE /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 22:28:02.450723 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-98d5efc8-92de-4cf2-a717-4ee0719d9d65 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:02.451335 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-98d5efc8-92de-4cf2-a717-4ee0719d9d65 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:02.457765 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-98d5efc8-92de-4cf2-a717-4ee0719d9d65 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:02.458244 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-98d5efc8-92de-4cf2-a717-4ee0719d9d65 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:02.458673 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-98d5efc8-92de-4cf2-a717-4ee0719d9d65 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:02.459366 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-98d5efc8-92de-4cf2-a717-4ee0719d9d65 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:02.459814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-98d5efc8-92de-4cf2-a717-4ee0719d9d65 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:02.460569 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-98d5efc8-92de-4cf2-a717-4ee0719d9d65 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:02.595611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-98d5efc8-92de-4cf2-a717-4ee0719d9d65 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:02.603439 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-98d5efc8-92de-4cf2-a717-4ee0719d9d65 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:02.605171 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-98d5efc8-92de-4cf2-a717-4ee0719d9d65 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:02.606416 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-98d5efc8-92de-4cf2-a717-4ee0719d9d65 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.159704 Aug 04 22:28:02.606964 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 393/781] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:02 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:28:03.629767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3ea58ac7-e1f0-4509-aa88-eae696830f7a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:03.630466 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3ea58ac7-e1f0-4509-aa88-eae696830f7a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:03.636672 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3ea58ac7-e1f0-4509-aa88-eae696830f7a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:03.637152 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3ea58ac7-e1f0-4509-aa88-eae696830f7a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:03.637630 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3ea58ac7-e1f0-4509-aa88-eae696830f7a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:03.638327 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3ea58ac7-e1f0-4509-aa88-eae696830f7a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:03.638779 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3ea58ac7-e1f0-4509-aa88-eae696830f7a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:03.639201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3ea58ac7-e1f0-4509-aa88-eae696830f7a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:03.778097 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3ea58ac7-e1f0-4509-aa88-eae696830f7a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:03.787019 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3ea58ac7-e1f0-4509-aa88-eae696830f7a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:03.788526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3ea58ac7-e1f0-4509-aa88-eae696830f7a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:03.789708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3ea58ac7-e1f0-4509-aa88-eae696830f7a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.165344 Aug 04 22:28:03.790306 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 389/782] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:03 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:28:04.813083 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d6c65593-82f4-4498-85e4-20e5e2131c57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:04.813707 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d6c65593-82f4-4498-85e4-20e5e2131c57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:04.819895 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d6c65593-82f4-4498-85e4-20e5e2131c57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:04.820385 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d6c65593-82f4-4498-85e4-20e5e2131c57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:04.820818 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d6c65593-82f4-4498-85e4-20e5e2131c57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:04.821560 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d6c65593-82f4-4498-85e4-20e5e2131c57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:04.822015 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d6c65593-82f4-4498-85e4-20e5e2131c57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:04.822438 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d6c65593-82f4-4498-85e4-20e5e2131c57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:05.251283 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d6c65593-82f4-4498-85e4-20e5e2131c57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:05.259348 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d6c65593-82f4-4498-85e4-20e5e2131c57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:05.260848 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d6c65593-82f4-4498-85e4-20e5e2131c57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:05.262034 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d6c65593-82f4-4498-85e4-20e5e2131c57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1728 microversion: 2.20 time: 0.453627 Aug 04 22:28:05.262623 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 394/783] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:04 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1728 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:28:05.831260 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-5d99cd80-19c7-4d93-9de0-4de68d1070d1 req-5d3d022c-1f02-42f8-a341-72bb9a469f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb440660-4715-48f6-a7ff-f0b74dfefe21", "name": "network-vif-deleted", "tag": "417dd402-4a58-49ce-a237-c5d14b0ce44d"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:05.844732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-5d99cd80-19c7-4d93-9de0-4de68d1070d1 req-5d3d022c-1f02-42f8-a341-72bb9a469f2a service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:05.845236 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-5d99cd80-19c7-4d93-9de0-4de68d1070d1 req-5d3d022c-1f02-42f8-a341-72bb9a469f2a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:05.845709 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-5d99cd80-19c7-4d93-9de0-4de68d1070d1 req-5d3d022c-1f02-42f8-a341-72bb9a469f2a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:05.858102 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-5d99cd80-19c7-4d93-9de0-4de68d1070d1 req-5d3d022c-1f02-42f8-a341-72bb9a469f2a service nova] Creating event network-vif-deleted:417dd402-4a58-49ce-a237-c5d14b0ce44d for instance eb440660-4715-48f6-a7ff-f0b74dfefe21 on hv-cinder-85221 Aug 04 22:28:05.863491 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-5d99cd80-19c7-4d93-9de0-4de68d1070d1 req-5d3d022c-1f02-42f8-a341-72bb9a469f2a service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037013 Aug 04 22:28:05.864471 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 390/784] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:06.284845 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:06.285490 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:06.291847 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:06.292634 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:06.293146 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:06.293969 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:06.294500 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:06.295147 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:06.340230 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:06.340956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:06.341610 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:06.342219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.objects.instance [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lazy-loading 'fault' on Instance uuid eb440660-4715-48f6-a7ff-f0b74dfefe21 {{(pid=129197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:28:06.393560 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:06.403876 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:06.407603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:06.410016 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-29235673-717d-4aae-9035-554dc9d22e18 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 200 len: 1376 microversion: 2.20 time: 0.129700 Aug 04 22:28:06.410963 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 395/785] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:06 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 1376 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:28:07.435179 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9b81823d-db72-4e91-b963-2778ae8a0f25 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:07.435828 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9b81823d-db72-4e91-b963-2778ae8a0f25 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:07.442745 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9b81823d-db72-4e91-b963-2778ae8a0f25 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:07.443231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9b81823d-db72-4e91-b963-2778ae8a0f25 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:07.443674 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9b81823d-db72-4e91-b963-2778ae8a0f25 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:07.444365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9b81823d-db72-4e91-b963-2778ae8a0f25 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:07.444824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9b81823d-db72-4e91-b963-2778ae8a0f25 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:07.445254 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9b81823d-db72-4e91-b963-2778ae8a0f25 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:07.458524 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-9b81823d-db72-4e91-b963-2778ae8a0f25 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] HTTP exception thrown: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9b81823d-db72-4e91-b963-2778ae8a0f25 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Request method failure captured: Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 HTTP/1.1 Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYgIR9TWa02DixwRuI9JW-Nzd3cRgdYjC9HycYiUFfTZbOLQ9r6lQgS8f9umJI1hZWiTwYSaOSrZE84-3bBOgRilYmlQbR0xxiLdzDZdieq9wwY_7IdM4wxZYa8P3PRUE-U2karUzYImG3Egn1Q23LD9lr7Si9YnLEVlVMt5n0dpSQ Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 21d013d03bbc4f8ead46aca55d441eb1 Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:28:07.460141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:28:07.461898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/21d013d03bbc4f8ead46aca55d441eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_21d013d03bbc4f8ead46aca55d441eb1", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/21d013d03bbc4f8ead46aca55d441eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/21d013d03bbc4f8ead46aca55d441eb1"}]}] Aug 04 22:28:07.461898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:28:07.461898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 21d013d03bbc4f8ead46aca55d441eb1 Aug 04 22:28:07.461898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:28:07.461898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeShelveTestJSON-1532738363-project Aug 04 22:28:07.461898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:28:07.461898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:28:07.461898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 8c0aa2b9a5ac46f9bede8d007dcd3504 Aug 04 22:28:07.461898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1532738363-project Aug 04 22:28:07.461898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:28:07.461898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:28:07.461898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'eb440660-4715-48f6-a7ff-f0b74dfefe21'} Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:28:07.463063 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:28:07.464594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:07.466114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9b81823d-db72-4e91-b963-2778ae8a0f25 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Returning 404 to user: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:28:07.466114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9b81823d-db72-4e91-b963-2778ae8a0f25 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 404 len: 111 microversion: 2.20 time: 0.031090 Aug 04 22:28:07.466114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 391/786] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:07 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 22:28:07.470544 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7d68d220-105e-40a3-bf64-c3f1c7158070 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '.version_select at 0x7fe7b186f8b0>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:07.494916 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7d68d220-105e-40a3-bf64-c3f1c7158070 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091670201" status: 204 len: 0 microversion: 2.20 time: 0.028329 Aug 04 22:28:07.495476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 396/787] 10.222.0.109 () {60 vars in 1267 bytes} [Thu Aug 4 22:28:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091670201 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 22:28:08.158800 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9dbd17ec-abba-47c2-8e45-fd8bafeb8a3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Action: 'create', calling method: .version_select at 0x7fe7b17a1f70>, body: {"keypair": {"name": "tempest-keypair-2135478882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlEsZFaxYickUatJ5I4ENDgtXRHBoe4E4vTnXrp6BmqEMieh1WNGW9gPqZUgacQ3vOXBSc7Xv2eF979HoJ37lNNRG/Eb5FjK3tr26NrPX+E8eBdzSA8FSxXdG8qwqghXQ=="}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:08.174113 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-9dbd17ec-abba-47c2-8e45-fd8bafeb8a3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Getting quotas for project 21d013d03bbc4f8ead46aca55d441eb1. Resources: {'key_pairs'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:28:08.177936 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-9dbd17ec-abba-47c2-8e45-fd8bafeb8a3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Getting quotas for user 8c0aa2b9a5ac46f9bede8d007dcd3504 and project 21d013d03bbc4f8ead46aca55d441eb1. Resources: {'key_pairs'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:28:08.199523 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9dbd17ec-abba-47c2-8e45-fd8bafeb8a3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045244 Aug 04 22:28:08.200112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 392/788] 10.222.0.109 () {62 vars in 1205 bytes} [Thu Aug 4 22:28:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 22:28:08.607825 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-51f73e4f-ccfb-48e1-94f0-78ab7e907898 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:08.608638 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-51f73e4f-ccfb-48e1-94f0-78ab7e907898 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:08.616523 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-51f73e4f-ccfb-48e1-94f0-78ab7e907898 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:08.617067 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-51f73e4f-ccfb-48e1-94f0-78ab7e907898 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:08.617675 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-51f73e4f-ccfb-48e1-94f0-78ab7e907898 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:08.618504 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-51f73e4f-ccfb-48e1-94f0-78ab7e907898 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:08.619001 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-51f73e4f-ccfb-48e1-94f0-78ab7e907898 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:08.619467 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-51f73e4f-ccfb-48e1-94f0-78ab7e907898 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:08.644647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-51f73e4f-ccfb-48e1-94f0-78ab7e907898 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9/ips" status: 200 len: 150 microversion: 2.1 time: 0.040898 Aug 04 22:28:08.645434 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 397/789] 10.222.0.109 () {58 vars in 1253 bytes} [Thu Aug 4 22:28:08 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:08.657041 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e46c4953-f226-4a23-be11-a44a7efd30bf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38197de4-0a66-4917-9ad8-58382d035e37"}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:08.659503 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e46c4953-f226-4a23-be11-a44a7efd30bf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:08.666810 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e46c4953-f226-4a23-be11-a44a7efd30bf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:08.667373 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e46c4953-f226-4a23-be11-a44a7efd30bf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:08.667886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e46c4953-f226-4a23-be11-a44a7efd30bf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:08.668663 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e46c4953-f226-4a23-be11-a44a7efd30bf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:08.669182 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e46c4953-f226-4a23-be11-a44a7efd30bf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:08.669637 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e46c4953-f226-4a23-be11-a44a7efd30bf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:08.760869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-e46c4953-f226-4a23-be11-a44a7efd30bf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Invalid volume: volume 38197de4-0a66-4917-9ad8-58382d035e37 is already attached to instances: a9533fa0-d1ed-4df8-9a1f-d754b79c5394 Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e46c4953-f226-4a23-be11-a44a7efd30bf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: POST /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9/os-volume_attachments HTTP/1.1 Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 74 Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:28:08.762732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:28:08.764432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:28:08.764432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:28:08.764432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:28:08.764432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:28:08.764432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:28:08.764432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:28:08.764432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:28:08.764432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:28:08.764432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:28:08.764432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Aug 04 22:28:08.764432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {"volumeAttachment": {"volumeId": "38197de4-0a66-4917-9ad8-58382d035e37"}} Aug 04 22:28:08.764432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Invalid volume: volume 38197de4-0a66-4917-9ad8-58382d035e37 is already attached to instances: a9533fa0-d1ed-4df8-9a1f-d754b79c5394 Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'server_id': 'b377be43-9cb6-4bf2-9702-a280d8cc51b9', 'body': {'volumeAttachment': {'volumeId': '38197de4-0a66-4917-9ad8-58382d035e37'}}} Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 38197de4-0a66-4917-9ad8-58382d035e37 is already attached to instances: a9533fa0-d1ed-4df8-9a1f-d754b79c5394 Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:08.765379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 38197de4-0a66-4917-9ad8-58382d035e37 is already attached to instances: a9533fa0-d1ed-4df8-9a1f-d754b79c5394 Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:08.766847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:08.768126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:08.768126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:28:08.768126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:28:08.768126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 38197de4-0a66-4917-9ad8-58382d035e37 is already attached to instances: a9533fa0-d1ed-4df8-9a1f-d754b79c5394 Aug 04 22:28:08.768126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:08.768126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e46c4953-f226-4a23-be11-a44a7efd30bf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 400 to user: Invalid volume: volume 38197de4-0a66-4917-9ad8-58382d035e37 is already attached to instances: a9533fa0-d1ed-4df8-9a1f-d754b79c5394 {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:28:08.768126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e46c4953-f226-4a23-be11-a44a7efd30bf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "POST /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111413 Aug 04 22:28:08.768126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 393/790] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:28:08 2022] POST /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 22:28:08.775393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e8572e7c-da67-497a-a682-7da7e446730d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:08.775905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e8572e7c-da67-497a-a682-7da7e446730d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:08.782547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e8572e7c-da67-497a-a682-7da7e446730d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:08.783058 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e8572e7c-da67-497a-a682-7da7e446730d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:08.783481 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e8572e7c-da67-497a-a682-7da7e446730d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:08.784184 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e8572e7c-da67-497a-a682-7da7e446730d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:08.784647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e8572e7c-da67-497a-a682-7da7e446730d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:08.785067 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e8572e7c-da67-497a-a682-7da7e446730d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:08.814749 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e8572e7c-da67-497a-a682-7da7e446730d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Going to try to terminate instance {{(pid=129197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:28:08.892852 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e8572e7c-da67-497a-a682-7da7e446730d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 204 len: 0 microversion: 2.1 time: 0.122540 Aug 04 22:28:08.893942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 398/791] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:28:08 2022] DELETE /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:28:08.903821 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9832999f-5e54-4cee-8e4c-75339099f225 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:08.904590 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9832999f-5e54-4cee-8e4c-75339099f225 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:08.913627 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9832999f-5e54-4cee-8e4c-75339099f225 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:08.914222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9832999f-5e54-4cee-8e4c-75339099f225 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:08.914870 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9832999f-5e54-4cee-8e4c-75339099f225 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:08.915667 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9832999f-5e54-4cee-8e4c-75339099f225 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:08.916224 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9832999f-5e54-4cee-8e4c-75339099f225 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:08.916746 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9832999f-5e54-4cee-8e4c-75339099f225 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:09.127540 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9832999f-5e54-4cee-8e4c-75339099f225 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:09.135803 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9832999f-5e54-4cee-8e4c-75339099f225 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1687 microversion: 2.1 time: 0.235884 Aug 04 22:28:09.136462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 394/792] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:08 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1687 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:09.577589 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1148794724", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58b39d14-c9eb-4bd7-8ba8-cccc6c357f15"}], "security_groups": [{"name": "tempest-securitygroup--1501382121"}], "key_name": "tempest-keypair-2135478882", "user_data": "}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:09.698011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.network.neutron [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] validate_networks() for [('58b39d14-c9eb-4bd7-8ba8-cccc6c357f15', None, None, None, None, None)] {{(pid=129197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:28:10.158768 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-56bcf0cd-944a-4bab-826f-d986202ee492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:10.159454 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-56bcf0cd-944a-4bab-826f-d986202ee492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:10.165958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-56bcf0cd-944a-4bab-826f-d986202ee492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:10.166435 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-56bcf0cd-944a-4bab-826f-d986202ee492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:10.166868 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-56bcf0cd-944a-4bab-826f-d986202ee492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:10.167555 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-56bcf0cd-944a-4bab-826f-d986202ee492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:10.168003 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-56bcf0cd-944a-4bab-826f-d986202ee492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:10.168423 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-56bcf0cd-944a-4bab-826f-d986202ee492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:10.172715 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Flavor limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:28:10.173139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Image limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:28:10.173659 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Flavor pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:28:10.174092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Image pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:28:10.174498 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:28:10.183007 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:10.183484 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:10.183911 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:10.184629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:10.185073 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:10.185516 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:10.201919 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Getting quotas for project 21d013d03bbc4f8ead46aca55d441eb1. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:28:10.205995 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Getting quotas for user 8c0aa2b9a5ac46f9bede8d007dcd3504 and project 21d013d03bbc4f8ead46aca55d441eb1. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:28:10.217099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Going to run 1 instances... {{(pid=129197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:28:10.220039 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:28:10.270740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-31b57614-320f-4f22-810f-a83b37d9bc4e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.697870 Aug 04 22:28:10.271764 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 399/793] 10.222.0.109 () {62 vars in 1193 bytes} [Thu Aug 4 22:28:09 2022] POST /compute/v2.1/servers => generated 404 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 22:28:10.283834 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-95969017-9811-40ab-aee2-84dd3a80444f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:10.284446 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-95969017-9811-40ab-aee2-84dd3a80444f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:10.312035 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-56bcf0cd-944a-4bab-826f-d986202ee492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:10.320814 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-56bcf0cd-944a-4bab-826f-d986202ee492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1687 microversion: 2.1 time: 0.166625 Aug 04 22:28:10.321603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 395/794] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:10 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:28:10.350982 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-95969017-9811-40ab-aee2-84dd3a80444f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:10.359592 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-95969017-9811-40ab-aee2-84dd3a80444f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:10.361104 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-95969017-9811-40ab-aee2-84dd3a80444f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:10.362275 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-95969017-9811-40ab-aee2-84dd3a80444f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1286 microversion: 2.20 time: 0.083459 Aug 04 22:28:10.362847 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 400/795] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:10 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:28:11.347808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-cf1b230d-edfe-4407-9dbc-9e7c6ecdf228 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:11.349002 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-cf1b230d-edfe-4407-9dbc-9e7c6ecdf228 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:11.360705 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cf1b230d-edfe-4407-9dbc-9e7c6ecdf228 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:11.361614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cf1b230d-edfe-4407-9dbc-9e7c6ecdf228 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:11.362965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cf1b230d-edfe-4407-9dbc-9e7c6ecdf228 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:11.364206 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cf1b230d-edfe-4407-9dbc-9e7c6ecdf228 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:11.365018 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cf1b230d-edfe-4407-9dbc-9e7c6ecdf228 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:11.366604 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cf1b230d-edfe-4407-9dbc-9e7c6ecdf228 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:11.384037 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0ef71bea-fe5b-425f-a245-437fc6ef0e6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:11.384629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0ef71bea-fe5b-425f-a245-437fc6ef0e6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:11.393495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0ef71bea-fe5b-425f-a245-437fc6ef0e6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:11.394018 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0ef71bea-fe5b-425f-a245-437fc6ef0e6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:11.394454 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0ef71bea-fe5b-425f-a245-437fc6ef0e6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:11.395261 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0ef71bea-fe5b-425f-a245-437fc6ef0e6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:11.395731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0ef71bea-fe5b-425f-a245-437fc6ef0e6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:11.396154 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0ef71bea-fe5b-425f-a245-437fc6ef0e6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:11.490500 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0ef71bea-fe5b-425f-a245-437fc6ef0e6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:11.505731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0ef71bea-fe5b-425f-a245-437fc6ef0e6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:11.508597 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0ef71bea-fe5b-425f-a245-437fc6ef0e6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:11.510519 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-cf1b230d-edfe-4407-9dbc-9e7c6ecdf228 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:11.510758 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0ef71bea-fe5b-425f-a245-437fc6ef0e6e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1338 microversion: 2.20 time: 0.130200 Aug 04 22:28:11.521386 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 401/796] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:11 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1338 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:28:11.527818 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-cf1b230d-edfe-4407-9dbc-9e7c6ecdf228 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1687 microversion: 2.1 time: 0.188098 Aug 04 22:28:11.529682 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 396/797] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:11 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1687 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:12.479985 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-8b023dec-d853-4b1f-8158-3e26f026bc22 req-09fcf20d-6d89-4925-87a6-260c0c836e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b377be43-9cb6-4bf2-9702-a280d8cc51b9", "name": "network-vif-deleted", "tag": "74713ddd-d0bb-4812-8557-156b3e19e333"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:12.503121 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-8b023dec-d853-4b1f-8158-3e26f026bc22 req-09fcf20d-6d89-4925-87a6-260c0c836e39 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:12.503626 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-8b023dec-d853-4b1f-8158-3e26f026bc22 req-09fcf20d-6d89-4925-87a6-260c0c836e39 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:12.504063 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-8b023dec-d853-4b1f-8158-3e26f026bc22 req-09fcf20d-6d89-4925-87a6-260c0c836e39 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:12.521216 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-8b023dec-d853-4b1f-8158-3e26f026bc22 req-09fcf20d-6d89-4925-87a6-260c0c836e39 service nova] Creating event network-vif-deleted:74713ddd-d0bb-4812-8557-156b3e19e333 for instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 on hv-cinder-85221 Aug 04 22:28:12.526922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-8b023dec-d853-4b1f-8158-3e26f026bc22 req-09fcf20d-6d89-4925-87a6-260c0c836e39 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050727 Aug 04 22:28:12.527744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 402/798] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:28:12.544049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4437492b-dbc4-4e25-a3f1-1773d9257d70 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:12.544677 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4437492b-dbc4-4e25-a3f1-1773d9257d70 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:12.550381 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2e035626-f211-4718-a0eb-78bbd7ecbb9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:12.551341 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2e035626-f211-4718-a0eb-78bbd7ecbb9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:12.555678 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4437492b-dbc4-4e25-a3f1-1773d9257d70 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:12.556179 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4437492b-dbc4-4e25-a3f1-1773d9257d70 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:12.558682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e035626-f211-4718-a0eb-78bbd7ecbb9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:12.559502 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e035626-f211-4718-a0eb-78bbd7ecbb9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:12.560253 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e035626-f211-4718-a0eb-78bbd7ecbb9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:12.561229 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e035626-f211-4718-a0eb-78bbd7ecbb9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:12.561879 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e035626-f211-4718-a0eb-78bbd7ecbb9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:12.562497 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2e035626-f211-4718-a0eb-78bbd7ecbb9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:12.564421 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4437492b-dbc4-4e25-a3f1-1773d9257d70 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:12.565295 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4437492b-dbc4-4e25-a3f1-1773d9257d70 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:12.565812 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4437492b-dbc4-4e25-a3f1-1773d9257d70 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:12.566290 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4437492b-dbc4-4e25-a3f1-1773d9257d70 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:12.650639 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4437492b-dbc4-4e25-a3f1-1773d9257d70 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:12.658847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4437492b-dbc4-4e25-a3f1-1773d9257d70 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:12.661969 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4437492b-dbc4-4e25-a3f1-1773d9257d70 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:12.663247 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4437492b-dbc4-4e25-a3f1-1773d9257d70 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1344 microversion: 2.20 time: 0.123888 Aug 04 22:28:12.664287 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 397/799] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:12 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1344 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:28:12.672470 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2e035626-f211-4718-a0eb-78bbd7ecbb9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:12.680086 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2e035626-f211-4718-a0eb-78bbd7ecbb9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 200 len: 1331 microversion: 2.1 time: 0.134287 Aug 04 22:28:12.694982 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 403/800] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:12 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 1331 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:28:13.096610 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1212887926", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1619943125", "security_groups": [{"name": "tempest-secgroup-smoke-465478551"}], "networks": [{"uuid": "ebc5cf55-9b15-476b-b761-c2ee1174a0d2"}], "block_device_mapping_v2": [{"uuid": "0769d5c9-1cfa-49f9-8f89-1ecdeb32ee18", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:13.247618 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.network.neutron [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] validate_networks() for [('ebc5cf55-9b15-476b-b761-c2ee1174a0d2', None, None, None, None, None)] {{(pid=129196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:28:13.677374 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Flavor limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:28:13.677921 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Image limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:28:13.678335 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Flavor pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:28:13.678933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Image pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:28:13.681130 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:28:13.686561 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-278805a6-46c8-4486-b92f-e9fbc6919f57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:13.688011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-278805a6-46c8-4486-b92f-e9fbc6919f57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:13.690873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:13.691927 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:13.692393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:13.693161 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:13.693660 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:13.694096 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:13.698193 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-278805a6-46c8-4486-b92f-e9fbc6919f57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:13.699027 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-278805a6-46c8-4486-b92f-e9fbc6919f57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:13.699764 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-278805a6-46c8-4486-b92f-e9fbc6919f57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:13.700723 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-278805a6-46c8-4486-b92f-e9fbc6919f57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:13.701402 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-278805a6-46c8-4486-b92f-e9fbc6919f57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:13.702445 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-278805a6-46c8-4486-b92f-e9fbc6919f57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:13.726508 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Getting quotas for project 5bff3367439f45a7b7a420b66dd8574a. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:28:13.732268 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Getting quotas for user aaa106f1923b43dcb4ca4973815108c0 and project 5bff3367439f45a7b7a420b66dd8574a. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:28:13.800757 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Going to run 1 instances... {{(pid=129196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:28:13.803635 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0769d5c9-1cfa-49f9-8f89-1ecdeb32ee18',volume_size=None,volume_type=None)] {{(pid=129196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:28:13.946234 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a0ae7e84-ec36-4a1d-bca0-2674de5fdf29 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.853356 Aug 04 22:28:13.950794 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 398/801] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:28:13 2022] POST /compute/v2.1/servers => generated 407 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:28:13.951769 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a0d1a545-8a5d-4569-b311-04f29f16e711 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:13.952730 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a0d1a545-8a5d-4569-b311-04f29f16e711 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:13.958968 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a0d1a545-8a5d-4569-b311-04f29f16e711 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:13.959454 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a0d1a545-8a5d-4569-b311-04f29f16e711 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:13.959891 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a0d1a545-8a5d-4569-b311-04f29f16e711 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:13.960598 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a0d1a545-8a5d-4569-b311-04f29f16e711 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:13.961055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a0d1a545-8a5d-4569-b311-04f29f16e711 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:13.961518 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a0d1a545-8a5d-4569-b311-04f29f16e711 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:13.975755 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-a0d1a545-8a5d-4569-b311-04f29f16e711 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a0d1a545-8a5d-4569-b311-04f29f16e711 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 HTTP/1.1 Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:28:13.977311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:28:13.978958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:28:13.978958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:28:13.978958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:28:13.978958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:28:13.978958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:28:13.978958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:28:13.978958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:28:13.978958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:28:13.978958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:28:13.978958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:28:13.978958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:28:13.978958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'b377be43-9cb6-4bf2-9702-a280d8cc51b9'} Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:28:13.980112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:28:13.981881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:13.983979 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a0d1a545-8a5d-4569-b311-04f29f16e711 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 404 to user: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:28:13.983979 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a0d1a545-8a5d-4569-b311-04f29f16e711 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 404 len: 111 microversion: 2.1 time: 0.030647 Aug 04 22:28:13.983979 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 399/802] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:13 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:28:13.988649 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9947dbf0-2c2a-4833-8fe9-81aacd5c47b1 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:13.988858 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9947dbf0-2c2a-4833-8fe9-81aacd5c47b1 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:14.045736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9947dbf0-2c2a-4833-8fe9-81aacd5c47b1 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:14.052821 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9947dbf0-2c2a-4833-8fe9-81aacd5c47b1 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1092 microversion: 2.1 time: 0.068275 Aug 04 22:28:14.053425 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 400/803] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:13 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:14.058890 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-524bad94-1443-436b-b033-2157d34e4eea tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '.version_select at 0x7fe7b1790820>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:14.081851 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-524bad94-1443-436b-b033-2157d34e4eea tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552336069" status: 202 len: 0 microversion: 2.1 time: 0.026961 Aug 04 22:28:14.082648 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 401/804] 10.222.0.109 () {58 vars in 1226 bytes} [Thu Aug 4 22:28:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552336069 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:28:14.118221 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-278805a6-46c8-4486-b92f-e9fbc6919f57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:14.137044 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-278805a6-46c8-4486-b92f-e9fbc6919f57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:14.140402 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-278805a6-46c8-4486-b92f-e9fbc6919f57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:14.141678 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-278805a6-46c8-4486-b92f-e9fbc6919f57 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1412 microversion: 2.20 time: 0.459173 Aug 04 22:28:14.143159 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 404/805] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:13 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1412 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:28:14.549337 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-587bbd30-7001-4df4-ac92-8020b85b7b25 req-fbefbde6-d10d-43d2-9f9d-59814328ef1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e61c4e-2c74-44c2-90bd-f997db2fbd0a", "tag": "9bb4a82b-caa1-4ea9-a34f-05e170ce6471"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:14.559736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-587bbd30-7001-4df4-ac92-8020b85b7b25 req-fbefbde6-d10d-43d2-9f9d-59814328ef1a service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:14.560230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-587bbd30-7001-4df4-ac92-8020b85b7b25 req-fbefbde6-d10d-43d2-9f9d-59814328ef1a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:14.560670 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-587bbd30-7001-4df4-ac92-8020b85b7b25 req-fbefbde6-d10d-43d2-9f9d-59814328ef1a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:14.574508 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-587bbd30-7001-4df4-ac92-8020b85b7b25 req-fbefbde6-d10d-43d2-9f9d-59814328ef1a service nova] Creating event network-changed:9bb4a82b-caa1-4ea9-a34f-05e170ce6471 for instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a on hv-cinder-85221 Aug 04 22:28:14.581344 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-587bbd30-7001-4df4-ac92-8020b85b7b25 req-fbefbde6-d10d-43d2-9f9d-59814328ef1a service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036859 Aug 04 22:28:14.582299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 402/806] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:15.048122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bac63d8a-70ec-4c34-b848-6a53e1c2ca73 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:15.048629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bac63d8a-70ec-4c34-b848-6a53e1c2ca73 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:15.054499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bac63d8a-70ec-4c34-b848-6a53e1c2ca73 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:15.054980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bac63d8a-70ec-4c34-b848-6a53e1c2ca73 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:15.055437 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bac63d8a-70ec-4c34-b848-6a53e1c2ca73 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:15.056119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bac63d8a-70ec-4c34-b848-6a53e1c2ca73 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:15.056566 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bac63d8a-70ec-4c34-b848-6a53e1c2ca73 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:15.056980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bac63d8a-70ec-4c34-b848-6a53e1c2ca73 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:15.075077 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-eec8a001-4000-4ed5-89f5-5ecafeda2b88 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:15.075886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-eec8a001-4000-4ed5-89f5-5ecafeda2b88 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:15.081933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eec8a001-4000-4ed5-89f5-5ecafeda2b88 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:15.082420 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eec8a001-4000-4ed5-89f5-5ecafeda2b88 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:15.082857 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eec8a001-4000-4ed5-89f5-5ecafeda2b88 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:15.083550 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eec8a001-4000-4ed5-89f5-5ecafeda2b88 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:15.084018 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eec8a001-4000-4ed5-89f5-5ecafeda2b88 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:15.084446 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eec8a001-4000-4ed5-89f5-5ecafeda2b88 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:15.139790 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.objects.instance [None req-bac63d8a-70ec-4c34-b848-6a53e1c2ca73 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lazy-loading 'services' on Instance uuid a9533fa0-d1ed-4df8-9a1f-d754b79c5394 {{(pid=129197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:28:15.150299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-eec8a001-4000-4ed5-89f5-5ecafeda2b88 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:15.158220 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-eec8a001-4000-4ed5-89f5-5ecafeda2b88 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1190 microversion: 2.1 time: 0.087290 Aug 04 22:28:15.158790 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 403/807] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:15 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:28:15.166126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e8f0281e-9cbb-44a8-b88d-5562fd119adb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:15.166734 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e8f0281e-9cbb-44a8-b88d-5562fd119adb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:15.176469 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e8f0281e-9cbb-44a8-b88d-5562fd119adb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:15.176954 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e8f0281e-9cbb-44a8-b88d-5562fd119adb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:15.177389 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e8f0281e-9cbb-44a8-b88d-5562fd119adb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:15.178126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e8f0281e-9cbb-44a8-b88d-5562fd119adb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:15.178577 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e8f0281e-9cbb-44a8-b88d-5562fd119adb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:15.178998 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e8f0281e-9cbb-44a8-b88d-5562fd119adb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:15.215915 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bac63d8a-70ec-4c34-b848-6a53e1c2ca73 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-volume_attachments/38197de4-0a66-4917-9ad8-58382d035e37" status: 202 len: 0 microversion: 2.1 time: 0.172039 Aug 04 22:28:15.216647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 405/808] 10.222.0.109 () {58 vars in 1421 bytes} [Thu Aug 4 22:28:15 2022] DELETE /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-volume_attachments/38197de4-0a66-4917-9ad8-58382d035e37 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:28:15.225504 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-cf17d3db-d394-4034-a483-b2982c7682aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:15.227848 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-cf17d3db-d394-4034-a483-b2982c7682aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:15.234946 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cf17d3db-d394-4034-a483-b2982c7682aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:15.235444 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cf17d3db-d394-4034-a483-b2982c7682aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:15.235881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cf17d3db-d394-4034-a483-b2982c7682aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:15.236578 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cf17d3db-d394-4034-a483-b2982c7682aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:15.237035 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cf17d3db-d394-4034-a483-b2982c7682aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:15.237502 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cf17d3db-d394-4034-a483-b2982c7682aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:15.266274 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-cf17d3db-d394-4034-a483-b2982c7682aa tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044813 Aug 04 22:28:15.266881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 406/809] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:28:15 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:28:15.313864 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e8f0281e-9cbb-44a8-b88d-5562fd119adb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:15.321884 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e8f0281e-9cbb-44a8-b88d-5562fd119adb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:15.323385 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e8f0281e-9cbb-44a8-b88d-5562fd119adb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:15.324481 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e8f0281e-9cbb-44a8-b88d-5562fd119adb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1412 microversion: 2.20 time: 0.162011 Aug 04 22:28:15.325037 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 404/810] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:15 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1412 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:28:16.179699 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2aee503e-9767-4ef2-8e67-3cb284175a1b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:16.180346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2aee503e-9767-4ef2-8e67-3cb284175a1b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:16.186820 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2aee503e-9767-4ef2-8e67-3cb284175a1b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:16.187380 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2aee503e-9767-4ef2-8e67-3cb284175a1b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:16.187828 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2aee503e-9767-4ef2-8e67-3cb284175a1b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:16.188528 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2aee503e-9767-4ef2-8e67-3cb284175a1b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:16.188987 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2aee503e-9767-4ef2-8e67-3cb284175a1b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:16.189431 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2aee503e-9767-4ef2-8e67-3cb284175a1b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:16.207705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:16.253751 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2aee503e-9767-4ef2-8e67-3cb284175a1b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:16.261149 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2aee503e-9767-4ef2-8e67-3cb284175a1b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1190 microversion: 2.1 time: 0.085273 Aug 04 22:28:16.261748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 407/811] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:16 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1190 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:16.278499 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0d18253f-a042-49b3-92c9-846345ff055f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:16.280987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0d18253f-a042-49b3-92c9-846345ff055f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:16.287021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0d18253f-a042-49b3-92c9-846345ff055f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:16.287541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0d18253f-a042-49b3-92c9-846345ff055f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:16.287982 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0d18253f-a042-49b3-92c9-846345ff055f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:16.288672 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0d18253f-a042-49b3-92c9-846345ff055f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:16.289158 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0d18253f-a042-49b3-92c9-846345ff055f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:16.289656 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0d18253f-a042-49b3-92c9-846345ff055f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:16.319841 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0d18253f-a042-49b3-92c9-846345ff055f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045399 Aug 04 22:28:16.320395 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 405/812] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:28:16 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:16.347147 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-af1e8812-c12f-4919-87ab-facb28e02ed0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:16.347763 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-af1e8812-c12f-4919-87ab-facb28e02ed0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:16.353785 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-af1e8812-c12f-4919-87ab-facb28e02ed0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:16.354528 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-af1e8812-c12f-4919-87ab-facb28e02ed0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:16.354968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-af1e8812-c12f-4919-87ab-facb28e02ed0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:16.355662 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-af1e8812-c12f-4919-87ab-facb28e02ed0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:16.356119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-af1e8812-c12f-4919-87ab-facb28e02ed0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:16.356547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-af1e8812-c12f-4919-87ab-facb28e02ed0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:16.486734 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-af1e8812-c12f-4919-87ab-facb28e02ed0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:16.494498 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-af1e8812-c12f-4919-87ab-facb28e02ed0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:16.495982 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-af1e8812-c12f-4919-87ab-facb28e02ed0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:16.497069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-af1e8812-c12f-4919-87ab-facb28e02ed0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1412 microversion: 2.20 time: 0.153777 Aug 04 22:28:16.497649 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 408/813] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:16 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:28:17.282565 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-188c0d27-268f-44cc-a762-a06bcdbc3e9a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:17.283111 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-188c0d27-268f-44cc-a762-a06bcdbc3e9a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:17.289498 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-188c0d27-268f-44cc-a762-a06bcdbc3e9a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:17.290248 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-188c0d27-268f-44cc-a762-a06bcdbc3e9a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:17.290691 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-188c0d27-268f-44cc-a762-a06bcdbc3e9a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:17.291384 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-188c0d27-268f-44cc-a762-a06bcdbc3e9a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:17.291842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-188c0d27-268f-44cc-a762-a06bcdbc3e9a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:17.292270 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-188c0d27-268f-44cc-a762-a06bcdbc3e9a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:17.314155 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:17.334098 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-029c4aac-f576-47f5-a9bb-564f7722cda5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:17.338260 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-029c4aac-f576-47f5-a9bb-564f7722cda5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:17.347504 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-029c4aac-f576-47f5-a9bb-564f7722cda5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:17.348249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-029c4aac-f576-47f5-a9bb-564f7722cda5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:17.348686 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-029c4aac-f576-47f5-a9bb-564f7722cda5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:17.349636 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-029c4aac-f576-47f5-a9bb-564f7722cda5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:17.350304 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-029c4aac-f576-47f5-a9bb-564f7722cda5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:17.350902 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-029c4aac-f576-47f5-a9bb-564f7722cda5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:17.382746 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-188c0d27-268f-44cc-a762-a06bcdbc3e9a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:17.393130 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-188c0d27-268f-44cc-a762-a06bcdbc3e9a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1190 microversion: 2.1 time: 0.115176 Aug 04 22:28:17.405447 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 406/814] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:17 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1190 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:17.405670 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-029c4aac-f576-47f5-a9bb-564f7722cda5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065947 Aug 04 22:28:17.405670 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 409/815] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:28:17 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:28:17.519225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9d2f6337-45ce-46da-825c-f0e9eebb7569 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:17.519848 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9d2f6337-45ce-46da-825c-f0e9eebb7569 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:17.526124 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9d2f6337-45ce-46da-825c-f0e9eebb7569 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:17.526614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9d2f6337-45ce-46da-825c-f0e9eebb7569 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:17.527052 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9d2f6337-45ce-46da-825c-f0e9eebb7569 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:17.527749 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9d2f6337-45ce-46da-825c-f0e9eebb7569 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:17.528205 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9d2f6337-45ce-46da-825c-f0e9eebb7569 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:17.528636 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9d2f6337-45ce-46da-825c-f0e9eebb7569 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:17.661498 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9d2f6337-45ce-46da-825c-f0e9eebb7569 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:17.669268 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9d2f6337-45ce-46da-825c-f0e9eebb7569 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:17.671659 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9d2f6337-45ce-46da-825c-f0e9eebb7569 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:17.672765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9d2f6337-45ce-46da-825c-f0e9eebb7569 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1412 microversion: 2.20 time: 0.157595 Aug 04 22:28:17.673331 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 407/816] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:17 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1412 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:28:18.408427 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-75dfc2c4-608a-4f07-b1b4-e4ee6dcd3411 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:18.411423 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-75dfc2c4-608a-4f07-b1b4-e4ee6dcd3411 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:18.417362 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3c0386af-ac4b-49ed-97cc-55650b08f0e2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:18.418526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3c0386af-ac4b-49ed-97cc-55650b08f0e2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:18.419163 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75dfc2c4-608a-4f07-b1b4-e4ee6dcd3411 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:18.419794 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75dfc2c4-608a-4f07-b1b4-e4ee6dcd3411 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:18.420432 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75dfc2c4-608a-4f07-b1b4-e4ee6dcd3411 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:18.421313 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75dfc2c4-608a-4f07-b1b4-e4ee6dcd3411 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:18.421966 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75dfc2c4-608a-4f07-b1b4-e4ee6dcd3411 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:18.422398 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75dfc2c4-608a-4f07-b1b4-e4ee6dcd3411 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:18.426497 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3c0386af-ac4b-49ed-97cc-55650b08f0e2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:18.427000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3c0386af-ac4b-49ed-97cc-55650b08f0e2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:18.427440 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3c0386af-ac4b-49ed-97cc-55650b08f0e2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:18.428336 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3c0386af-ac4b-49ed-97cc-55650b08f0e2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:18.428801 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3c0386af-ac4b-49ed-97cc-55650b08f0e2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:18.429228 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3c0386af-ac4b-49ed-97cc-55650b08f0e2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:18.458359 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-75dfc2c4-608a-4f07-b1b4-e4ee6dcd3411 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055137 Aug 04 22:28:18.459869 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 410/817] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:28:18 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 22:28:18.529316 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3c0386af-ac4b-49ed-97cc-55650b08f0e2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:18.537682 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3c0386af-ac4b-49ed-97cc-55650b08f0e2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1208 microversion: 2.1 time: 0.124171 Aug 04 22:28:18.538523 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 408/818] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:18 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1208 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:18.555171 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-63fc1d37-5994-4575-ad20-946bc8604e47 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:18.555678 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-63fc1d37-5994-4575-ad20-946bc8604e47 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:18.565250 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-63fc1d37-5994-4575-ad20-946bc8604e47 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:18.565800 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-63fc1d37-5994-4575-ad20-946bc8604e47 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:18.566410 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-63fc1d37-5994-4575-ad20-946bc8604e47 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:18.567996 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-63fc1d37-5994-4575-ad20-946bc8604e47 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:18.568466 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-63fc1d37-5994-4575-ad20-946bc8604e47 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:18.568898 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-63fc1d37-5994-4575-ad20-946bc8604e47 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:18.597746 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-63fc1d37-5994-4575-ad20-946bc8604e47 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Going to try to terminate instance {{(pid=129197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:28:18.680318 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-63fc1d37-5994-4575-ad20-946bc8604e47 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 204 len: 0 microversion: 2.1 time: 0.130310 Aug 04 22:28:18.680933 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 411/819] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:28:18 2022] DELETE /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:28:18.690295 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d4058869-f34d-4bdd-b836-8154289085c9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:18.691252 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d4058869-f34d-4bdd-b836-8154289085c9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:18.697338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4058869-f34d-4bdd-b836-8154289085c9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:18.698154 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4058869-f34d-4bdd-b836-8154289085c9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:18.698793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4058869-f34d-4bdd-b836-8154289085c9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:18.700081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4058869-f34d-4bdd-b836-8154289085c9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:18.700746 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4058869-f34d-4bdd-b836-8154289085c9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:18.701435 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d4058869-f34d-4bdd-b836-8154289085c9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:18.701557 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9c6420e2-9857-4916-967f-dce5d35699ba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:18.702319 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-9c6420e2-9857-4916-967f-dce5d35699ba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:18.711628 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9c6420e2-9857-4916-967f-dce5d35699ba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:18.712391 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9c6420e2-9857-4916-967f-dce5d35699ba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:18.713247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9c6420e2-9857-4916-967f-dce5d35699ba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:18.714676 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9c6420e2-9857-4916-967f-dce5d35699ba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:18.715521 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9c6420e2-9857-4916-967f-dce5d35699ba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:18.716186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9c6420e2-9857-4916-967f-dce5d35699ba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:18.844403 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d4058869-f34d-4bdd-b836-8154289085c9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:18.851964 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d4058869-f34d-4bdd-b836-8154289085c9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1688 microversion: 2.1 time: 0.166577 Aug 04 22:28:18.853445 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 409/820] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:18 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:18.959726 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9c6420e2-9857-4916-967f-dce5d35699ba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:18.970548 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9c6420e2-9857-4916-967f-dce5d35699ba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:18.975846 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9c6420e2-9857-4916-967f-dce5d35699ba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:18.977007 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9c6420e2-9857-4916-967f-dce5d35699ba tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1412 microversion: 2.20 time: 0.282142 Aug 04 22:28:18.977611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 412/821] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:18 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1412 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:28:19.560137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-cdd50522-7b43-415a-b0d1-6cca4d3ec4b5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:19.562105 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-cdd50522-7b43-415a-b0d1-6cca4d3ec4b5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:19.568531 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cdd50522-7b43-415a-b0d1-6cca4d3ec4b5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:19.569016 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cdd50522-7b43-415a-b0d1-6cca4d3ec4b5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:19.569481 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cdd50522-7b43-415a-b0d1-6cca4d3ec4b5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:19.570177 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cdd50522-7b43-415a-b0d1-6cca4d3ec4b5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:19.570678 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cdd50522-7b43-415a-b0d1-6cca4d3ec4b5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:19.571080 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cdd50522-7b43-415a-b0d1-6cca4d3ec4b5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:19.707492 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-cdd50522-7b43-415a-b0d1-6cca4d3ec4b5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:19.714831 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-cdd50522-7b43-415a-b0d1-6cca4d3ec4b5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.158533 Aug 04 22:28:19.715408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 410/822] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:19 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:19.765255 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-e08230fa-a203-4a8f-8ca5-afd139e80d4d req-f5c5ed6f-e24b-4580-8a15-b7823aa52bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd73ce87-41fe-4b81-9b4b-546962f70b2d", "tag": "568a695a-e288-47b9-b51b-cc0981c71810"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:19.775725 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-e08230fa-a203-4a8f-8ca5-afd139e80d4d req-f5c5ed6f-e24b-4580-8a15-b7823aa52bca service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:19.776355 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-e08230fa-a203-4a8f-8ca5-afd139e80d4d req-f5c5ed6f-e24b-4580-8a15-b7823aa52bca service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:19.776888 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-e08230fa-a203-4a8f-8ca5-afd139e80d4d req-f5c5ed6f-e24b-4580-8a15-b7823aa52bca service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:19.789902 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-e08230fa-a203-4a8f-8ca5-afd139e80d4d req-f5c5ed6f-e24b-4580-8a15-b7823aa52bca service nova] Creating event network-changed:568a695a-e288-47b9-b51b-cc0981c71810 for instance fd73ce87-41fe-4b81-9b4b-546962f70b2d on hv-cinder-85221 Aug 04 22:28:19.794776 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-e08230fa-a203-4a8f-8ca5-afd139e80d4d req-f5c5ed6f-e24b-4580-8a15-b7823aa52bca service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033568 Aug 04 22:28:19.797098 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 413/823] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:19.876285 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0c78536e-e123-4a07-99d8-d02f1d0b60c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:19.877007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0c78536e-e123-4a07-99d8-d02f1d0b60c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:19.884197 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0c78536e-e123-4a07-99d8-d02f1d0b60c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:19.884776 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0c78536e-e123-4a07-99d8-d02f1d0b60c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:19.885735 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0c78536e-e123-4a07-99d8-d02f1d0b60c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:19.886113 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0c78536e-e123-4a07-99d8-d02f1d0b60c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:19.886683 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0c78536e-e123-4a07-99d8-d02f1d0b60c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:19.887171 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0c78536e-e123-4a07-99d8-d02f1d0b60c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:19.944559 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-5d33a319-d230-4a7c-a9e6-9fc937cc9c37 req-48044885-303b-4527-82bd-b6b30b2d2fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e61c4e-2c74-44c2-90bd-f997db2fbd0a", "name": "network-vif-plugged", "status": "completed", "tag": "9bb4a82b-caa1-4ea9-a34f-05e170ce6471"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:19.961399 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-5d33a319-d230-4a7c-a9e6-9fc937cc9c37 req-48044885-303b-4527-82bd-b6b30b2d2fab service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:19.963010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-5d33a319-d230-4a7c-a9e6-9fc937cc9c37 req-48044885-303b-4527-82bd-b6b30b2d2fab service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:19.965639 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-5d33a319-d230-4a7c-a9e6-9fc937cc9c37 req-48044885-303b-4527-82bd-b6b30b2d2fab service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:19.981826 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-5d33a319-d230-4a7c-a9e6-9fc937cc9c37 req-48044885-303b-4527-82bd-b6b30b2d2fab service nova] Creating event network-vif-plugged:9bb4a82b-caa1-4ea9-a34f-05e170ce6471 for instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a on hv-cinder-85221 Aug 04 22:28:19.987939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-5d33a319-d230-4a7c-a9e6-9fc937cc9c37 req-48044885-303b-4527-82bd-b6b30b2d2fab service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049652 Aug 04 22:28:19.988756 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 414/824] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:28:20.001611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c1cc6281-d748-46ab-9b87-0071a6b4e53a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:20.004526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c1cc6281-d748-46ab-9b87-0071a6b4e53a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:20.011855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1cc6281-d748-46ab-9b87-0071a6b4e53a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:20.012679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1cc6281-d748-46ab-9b87-0071a6b4e53a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:20.013388 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1cc6281-d748-46ab-9b87-0071a6b4e53a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:20.015484 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1cc6281-d748-46ab-9b87-0071a6b4e53a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:20.016114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1cc6281-d748-46ab-9b87-0071a6b4e53a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:20.017704 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1cc6281-d748-46ab-9b87-0071a6b4e53a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:20.051982 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0c78536e-e123-4a07-99d8-d02f1d0b60c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:20.059820 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0c78536e-e123-4a07-99d8-d02f1d0b60c0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1688 microversion: 2.1 time: 0.188148 Aug 04 22:28:20.073097 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 411/825] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:19 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:20.193344 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:20.355453 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=8 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:20.373920 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c1cc6281-d748-46ab-9b87-0071a6b4e53a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:20.382159 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c1cc6281-d748-46ab-9b87-0071a6b4e53a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:20.383755 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c1cc6281-d748-46ab-9b87-0071a6b4e53a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:20.384944 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c1cc6281-d748-46ab-9b87-0071a6b4e53a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1412 microversion: 2.20 time: 0.388194 Aug 04 22:28:20.385633 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 415/826] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:19 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1412 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:28:20.737215 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-95ca5881-eb81-4461-8a17-422b1b28a51b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:20.737847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-95ca5881-eb81-4461-8a17-422b1b28a51b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:20.743947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95ca5881-eb81-4461-8a17-422b1b28a51b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:20.744429 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95ca5881-eb81-4461-8a17-422b1b28a51b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:20.744867 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95ca5881-eb81-4461-8a17-422b1b28a51b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:20.745668 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95ca5881-eb81-4461-8a17-422b1b28a51b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:20.746302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95ca5881-eb81-4461-8a17-422b1b28a51b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:20.748697 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95ca5881-eb81-4461-8a17-422b1b28a51b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:20.893081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-95ca5881-eb81-4461-8a17-422b1b28a51b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:20.900905 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-95ca5881-eb81-4461-8a17-422b1b28a51b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.168689 Aug 04 22:28:20.901495 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 412/827] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:20 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:21.080453 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-60e99876-5159-48a2-8d49-1ed2177c9f93 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:21.081346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-60e99876-5159-48a2-8d49-1ed2177c9f93 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:21.088093 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60e99876-5159-48a2-8d49-1ed2177c9f93 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:21.088698 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60e99876-5159-48a2-8d49-1ed2177c9f93 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:21.089242 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60e99876-5159-48a2-8d49-1ed2177c9f93 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:21.090092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60e99876-5159-48a2-8d49-1ed2177c9f93 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:21.090938 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60e99876-5159-48a2-8d49-1ed2177c9f93 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:21.091969 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60e99876-5159-48a2-8d49-1ed2177c9f93 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:21.165520 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-60e99876-5159-48a2-8d49-1ed2177c9f93 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:21.174617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-60e99876-5159-48a2-8d49-1ed2177c9f93 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1620 microversion: 2.1 time: 0.098252 Aug 04 22:28:21.175403 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 416/828] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:21 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1620 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:21.409605 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8b3c9347-98e0-4488-b7bb-0cf4422b1de6 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:21.410680 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8b3c9347-98e0-4488-b7bb-0cf4422b1de6 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:21.417779 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8b3c9347-98e0-4488-b7bb-0cf4422b1de6 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:21.418269 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8b3c9347-98e0-4488-b7bb-0cf4422b1de6 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:21.418763 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8b3c9347-98e0-4488-b7bb-0cf4422b1de6 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:21.419645 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8b3c9347-98e0-4488-b7bb-0cf4422b1de6 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:21.420960 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8b3c9347-98e0-4488-b7bb-0cf4422b1de6 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:21.421625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8b3c9347-98e0-4488-b7bb-0cf4422b1de6 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:21.571115 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8b3c9347-98e0-4488-b7bb-0cf4422b1de6 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:21.579827 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8b3c9347-98e0-4488-b7bb-0cf4422b1de6 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:21.581324 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8b3c9347-98e0-4488-b7bb-0cf4422b1de6 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:21.582602 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8b3c9347-98e0-4488-b7bb-0cf4422b1de6 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1412 microversion: 2.20 time: 0.178205 Aug 04 22:28:21.583157 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 413/829] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:21 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1412 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:28:21.925031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-cd9d00ad-83fd-4893-8f21-44945f99aefd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:21.928050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-cd9d00ad-83fd-4893-8f21-44945f99aefd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:21.944103 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cd9d00ad-83fd-4893-8f21-44945f99aefd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:21.944779 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cd9d00ad-83fd-4893-8f21-44945f99aefd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:21.945386 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cd9d00ad-83fd-4893-8f21-44945f99aefd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:21.946268 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cd9d00ad-83fd-4893-8f21-44945f99aefd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:21.947088 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cd9d00ad-83fd-4893-8f21-44945f99aefd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:21.948702 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cd9d00ad-83fd-4893-8f21-44945f99aefd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:22.083424 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-184a4ce0-07a7-421a-bec1-31c2869d1458 req-8daad7d9-1a9a-4532-a1fd-8c203fead416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9533fa0-d1ed-4df8-9a1f-d754b79c5394", "name": "network-vif-deleted", "tag": "fd292742-5a95-4c85-9714-6d6e9bd7487f"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:22.094535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-184a4ce0-07a7-421a-bec1-31c2869d1458 req-8daad7d9-1a9a-4532-a1fd-8c203fead416 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:22.095324 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-184a4ce0-07a7-421a-bec1-31c2869d1458 req-8daad7d9-1a9a-4532-a1fd-8c203fead416 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:22.095908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-184a4ce0-07a7-421a-bec1-31c2869d1458 req-8daad7d9-1a9a-4532-a1fd-8c203fead416 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:22.115078 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-184a4ce0-07a7-421a-bec1-31c2869d1458 req-8daad7d9-1a9a-4532-a1fd-8c203fead416 service nova] Creating event network-vif-deleted:fd292742-5a95-4c85-9714-6d6e9bd7487f for instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 on hv-cinder-85221 Aug 04 22:28:22.127247 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-184a4ce0-07a7-421a-bec1-31c2869d1458 req-8daad7d9-1a9a-4532-a1fd-8c203fead416 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047320 Aug 04 22:28:22.128490 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 414/830] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:22.196362 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:22.197099 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:22.204052 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:22.204540 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:22.204981 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:22.205722 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:22.206178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:22.206609 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:22.215869 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-cd9d00ad-83fd-4893-8f21-44945f99aefd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:22.223429 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-cd9d00ad-83fd-4893-8f21-44945f99aefd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.304616 Aug 04 22:28:22.223994 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 417/831] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:21 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:22.238836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:22.239323 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:22.240045 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:22.240506 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lazy-loading 'fault' on Instance uuid a9533fa0-d1ed-4df8-9a1f-d754b79c5394 {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:28:22.284298 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:22.291654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d1594f1a-8bbc-41c5-8448-0c67a759659e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 200 len: 1336 microversion: 2.1 time: 0.099641 Aug 04 22:28:22.292208 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 415/832] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:22 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:28:22.604936 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c49087e9-b474-4260-8415-5cbc68ed4b7d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:22.605578 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c49087e9-b474-4260-8415-5cbc68ed4b7d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:22.612151 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c49087e9-b474-4260-8415-5cbc68ed4b7d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:22.612643 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c49087e9-b474-4260-8415-5cbc68ed4b7d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:22.613080 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c49087e9-b474-4260-8415-5cbc68ed4b7d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:22.613802 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c49087e9-b474-4260-8415-5cbc68ed4b7d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:22.614262 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c49087e9-b474-4260-8415-5cbc68ed4b7d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:22.614687 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c49087e9-b474-4260-8415-5cbc68ed4b7d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:22.746573 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c49087e9-b474-4260-8415-5cbc68ed4b7d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:22.754758 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c49087e9-b474-4260-8415-5cbc68ed4b7d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:22.756299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c49087e9-b474-4260-8415-5cbc68ed4b7d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:22.757462 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c49087e9-b474-4260-8415-5cbc68ed4b7d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1605 microversion: 2.20 time: 0.156693 Aug 04 22:28:22.758031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 418/833] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:28:22 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:28:22.779867 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c6af97a4-03f7-4f1f-914e-7bcf72feb840 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:22.780353 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c6af97a4-03f7-4f1f-914e-7bcf72feb840 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:22.783341 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:22.787127 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c6af97a4-03f7-4f1f-914e-7bcf72feb840 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:22.787603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c6af97a4-03f7-4f1f-914e-7bcf72feb840 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:22.788035 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c6af97a4-03f7-4f1f-914e-7bcf72feb840 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:22.788716 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c6af97a4-03f7-4f1f-914e-7bcf72feb840 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:22.789164 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c6af97a4-03f7-4f1f-914e-7bcf72feb840 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:22.789615 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c6af97a4-03f7-4f1f-914e-7bcf72feb840 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:22.870041 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c6af97a4-03f7-4f1f-914e-7bcf72feb840 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094548 Aug 04 22:28:22.870633 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 416/834] 10.222.0.109 () {60 vars in 1321 bytes} [Thu Aug 4 22:28:22 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:28:23.244141 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bc21a694-eb91-46df-b19d-d0adf4a2df07 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:23.244777 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bc21a694-eb91-46df-b19d-d0adf4a2df07 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:23.251752 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc21a694-eb91-46df-b19d-d0adf4a2df07 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:23.252242 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc21a694-eb91-46df-b19d-d0adf4a2df07 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:23.252672 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc21a694-eb91-46df-b19d-d0adf4a2df07 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:23.253394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc21a694-eb91-46df-b19d-d0adf4a2df07 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:23.253903 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc21a694-eb91-46df-b19d-d0adf4a2df07 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:23.254320 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bc21a694-eb91-46df-b19d-d0adf4a2df07 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:23.313219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-84aca869-7f0d-478f-ac38-091339fcb91f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:23.314055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-84aca869-7f0d-478f-ac38-091339fcb91f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:23.320025 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84aca869-7f0d-478f-ac38-091339fcb91f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:23.321181 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84aca869-7f0d-478f-ac38-091339fcb91f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:23.321705 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84aca869-7f0d-478f-ac38-091339fcb91f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:23.322489 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84aca869-7f0d-478f-ac38-091339fcb91f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:23.323000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84aca869-7f0d-478f-ac38-091339fcb91f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:23.323594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84aca869-7f0d-478f-ac38-091339fcb91f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:23.343104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-84aca869-7f0d-478f-ac38-091339fcb91f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-84aca869-7f0d-478f-ac38-091339fcb91f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 HTTP/1.1 Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:28:23.344861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:28:23.346496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:28:23.346496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:28:23.346496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:28:23.346496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:28:23.346496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:28:23.346496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:28:23.346496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:28:23.346496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:28:23.346496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:28:23.346496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:28:23.346496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:28:23.346496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'a9533fa0-d1ed-4df8-9a1f-d754b79c5394'} Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:28:23.347357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:28:23.348754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:23.350087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-84aca869-7f0d-478f-ac38-091339fcb91f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 404 to user: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:28:23.350087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-84aca869-7f0d-478f-ac38-091339fcb91f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 404 len: 111 microversion: 2.1 time: 0.038342 Aug 04 22:28:23.351657 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 417/835] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:23 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 22:28:23.358308 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-facda9d6-6d67-4cf6-b01d-24275055b273 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '.version_select at 0x7fe7b16de550>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:23.380854 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-facda9d6-6d67-4cf6-b01d-24275055b273 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071018194" status: 202 len: 0 microversion: 2.1 time: 0.027088 Aug 04 22:28:23.381467 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 418/836] 10.222.0.109 () {58 vars in 1226 bytes} [Thu Aug 4 22:28:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071018194 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:28:23.411780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bc21a694-eb91-46df-b19d-d0adf4a2df07 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:23.421815 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bc21a694-eb91-46df-b19d-d0adf4a2df07 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.181463 Aug 04 22:28:23.422891 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 419/837] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:23 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:23.837709 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:23.841838 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-59d158cc-08e9-4aea-a705-b831d238a09a req-5917c9dc-e4e8-498d-8062-eba15f2dfe92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e61c4e-2c74-44c2-90bd-f997db2fbd0a", "tag": "9bb4a82b-caa1-4ea9-a34f-05e170ce6471"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:23.852516 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-59d158cc-08e9-4aea-a705-b831d238a09a req-5917c9dc-e4e8-498d-8062-eba15f2dfe92 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:23.852987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-59d158cc-08e9-4aea-a705-b831d238a09a req-5917c9dc-e4e8-498d-8062-eba15f2dfe92 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:23.853424 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-59d158cc-08e9-4aea-a705-b831d238a09a req-5917c9dc-e4e8-498d-8062-eba15f2dfe92 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:23.865011 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-59d158cc-08e9-4aea-a705-b831d238a09a req-5917c9dc-e4e8-498d-8062-eba15f2dfe92 service nova] Creating event network-changed:9bb4a82b-caa1-4ea9-a34f-05e170ce6471 for instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a on hv-cinder-85221 Aug 04 22:28:23.870111 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-59d158cc-08e9-4aea-a705-b831d238a09a req-5917c9dc-e4e8-498d-8062-eba15f2dfe92 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032780 Aug 04 22:28:23.871106 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 419/838] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:24.184541 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3237897d-e0e5-4c22-9000-0fb273c5d592 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Action: 'create', calling method: .version_select at 0x7fe7b186c0d0>, body: {"keypair": {"name": "tempest-keypair-356446245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbqykd1fpit/Zjen/T8aWoXbBzCxTg1oOrKzxSa+SWsIgdBcc0me1kS4FqKZt7tBXZ89lX+cXvzjSYbNRIUtNe+PBUW+2SOULGq1AQrwuKAf9qwjxBKylNQFcQUjw+NtA=="}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:24.200408 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-3237897d-e0e5-4c22-9000-0fb273c5d592 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for project 011b296da6654fa38f76eadd7bebae6f. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:28:24.204281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:24.206131 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-3237897d-e0e5-4c22-9000-0fb273c5d592 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for user 8c50160e51b54cde9a3f617d71fbf1c0 and project 011b296da6654fa38f76eadd7bebae6f. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:28:24.229053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3237897d-e0e5-4c22-9000-0fb273c5d592 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048025 Aug 04 22:28:24.233560 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 420/839] 10.222.0.109 () {60 vars in 1164 bytes} [Thu Aug 4 22:28:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:24.443730 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ecb8ed8b-94ff-4c4d-967d-b9d50cd743cb tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:24.444551 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ecb8ed8b-94ff-4c4d-967d-b9d50cd743cb tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:24.447908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=12 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:24.458307 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ecb8ed8b-94ff-4c4d-967d-b9d50cd743cb tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:24.459074 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ecb8ed8b-94ff-4c4d-967d-b9d50cd743cb tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:24.459673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ecb8ed8b-94ff-4c4d-967d-b9d50cd743cb tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:24.461458 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ecb8ed8b-94ff-4c4d-967d-b9d50cd743cb tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:24.462137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ecb8ed8b-94ff-4c4d-967d-b9d50cd743cb tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:24.463359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ecb8ed8b-94ff-4c4d-967d-b9d50cd743cb tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:24.648854 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-ecb8ed8b-94ff-4c4d-967d-b9d50cd743cb tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:24.657556 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ecb8ed8b-94ff-4c4d-967d-b9d50cd743cb tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.218378 Aug 04 22:28:24.658307 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 420/840] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:24 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:25.679537 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6ced80c3-8bfd-4d2f-9fdc-22c28647b441 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:25.680403 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6ced80c3-8bfd-4d2f-9fdc-22c28647b441 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:25.688048 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6ced80c3-8bfd-4d2f-9fdc-22c28647b441 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:25.688541 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6ced80c3-8bfd-4d2f-9fdc-22c28647b441 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:25.688953 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6ced80c3-8bfd-4d2f-9fdc-22c28647b441 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:25.689743 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6ced80c3-8bfd-4d2f-9fdc-22c28647b441 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:25.690191 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6ced80c3-8bfd-4d2f-9fdc-22c28647b441 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:25.690612 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6ced80c3-8bfd-4d2f-9fdc-22c28647b441 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:25.822541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2074946715", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b91150e-ffb3-48d1-826e-331e5df87d0e"}], "security_groups": [{"name": "tempest-securitygroup--1139242434"}], "key_name": "tempest-keypair-356446245", "user_data": "}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:25.866082 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6ced80c3-8bfd-4d2f-9fdc-22c28647b441 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:25.874864 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6ced80c3-8bfd-4d2f-9fdc-22c28647b441 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.199539 Aug 04 22:28:25.876018 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 421/841] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:25 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:25.930520 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.network.neutron [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] validate_networks() for [('7b91150e-ffb3-48d1-826e-331e5df87d0e', None, None, None, None, None)] {{(pid=129196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:28:26.314977 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Flavor limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:28:26.315414 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Image limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:28:26.315888 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Flavor pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:28:26.316300 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Image pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:28:26.316716 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:28:26.325853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:26.326335 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:26.326774 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:26.327505 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:26.327965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:26.328387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:26.346018 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for project 011b296da6654fa38f76eadd7bebae6f. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:28:26.351141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for user 8c50160e51b54cde9a3f617d71fbf1c0 and project 011b296da6654fa38f76eadd7bebae6f. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:28:26.364321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Going to run 1 instances... {{(pid=129196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:28:26.366793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:28:26.425892 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ca1a622a-36bf-4291-92cd-5a09c0295c2e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.607582 Aug 04 22:28:26.426542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 421/842] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:28:25 2022] POST /compute/v2.1/servers => generated 404 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 04 22:28:26.438431 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-8520f01b-f7d2-4b03-8a81-11883c6081b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:26.439061 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-8520f01b-f7d2-4b03-8a81-11883c6081b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:26.496525 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8520f01b-f7d2-4b03-8a81-11883c6081b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:26.503114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-8520f01b-f7d2-4b03-8a81-11883c6081b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1245 microversion: 2.1 time: 0.069619 Aug 04 22:28:26.503679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 422/843] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:26 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:26.897486 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5168b716-20f5-4f02-82a7-b8e57f9f3eee tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:26.898060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5168b716-20f5-4f02-82a7-b8e57f9f3eee tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:26.905333 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5168b716-20f5-4f02-82a7-b8e57f9f3eee tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:26.905858 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5168b716-20f5-4f02-82a7-b8e57f9f3eee tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:26.906295 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5168b716-20f5-4f02-82a7-b8e57f9f3eee tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:26.906995 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5168b716-20f5-4f02-82a7-b8e57f9f3eee tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:26.907451 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5168b716-20f5-4f02-82a7-b8e57f9f3eee tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:26.907878 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5168b716-20f5-4f02-82a7-b8e57f9f3eee tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:27.048289 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5168b716-20f5-4f02-82a7-b8e57f9f3eee tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:27.055653 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5168b716-20f5-4f02-82a7-b8e57f9f3eee tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.162677 Aug 04 22:28:27.056224 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 422/844] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:26 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:27.524421 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f95411c4-95ad-4146-8663-f7c69121669b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:27.525049 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f95411c4-95ad-4146-8663-f7c69121669b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:27.531924 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f95411c4-95ad-4146-8663-f7c69121669b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:27.532396 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f95411c4-95ad-4146-8663-f7c69121669b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:27.532816 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f95411c4-95ad-4146-8663-f7c69121669b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:27.533691 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f95411c4-95ad-4146-8663-f7c69121669b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:27.534151 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f95411c4-95ad-4146-8663-f7c69121669b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:27.534582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f95411c4-95ad-4146-8663-f7c69121669b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:27.615264 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f95411c4-95ad-4146-8663-f7c69121669b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:27.623801 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f95411c4-95ad-4146-8663-f7c69121669b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1315 microversion: 2.1 time: 0.103432 Aug 04 22:28:27.624660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 423/845] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:27 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1315 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:28.076813 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-fd2b0aed-4e0a-449b-93ee-7322c53b196c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:28.077370 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-fd2b0aed-4e0a-449b-93ee-7322c53b196c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:28.084462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd2b0aed-4e0a-449b-93ee-7322c53b196c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:28.084947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd2b0aed-4e0a-449b-93ee-7322c53b196c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:28.085391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd2b0aed-4e0a-449b-93ee-7322c53b196c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:28.086111 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd2b0aed-4e0a-449b-93ee-7322c53b196c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:28.086591 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd2b0aed-4e0a-449b-93ee-7322c53b196c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:28.087016 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd2b0aed-4e0a-449b-93ee-7322c53b196c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:28.236709 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-fd2b0aed-4e0a-449b-93ee-7322c53b196c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:28.245483 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-fd2b0aed-4e0a-449b-93ee-7322c53b196c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.173113 Aug 04 22:28:28.246162 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 423/846] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:28 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:28:28.644133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-22d08b33-c859-4752-9ab4-d5a8509b73ee tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:28.644845 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-22d08b33-c859-4752-9ab4-d5a8509b73ee tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:28.650844 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-22d08b33-c859-4752-9ab4-d5a8509b73ee tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:28.651329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-22d08b33-c859-4752-9ab4-d5a8509b73ee tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:28.651766 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-22d08b33-c859-4752-9ab4-d5a8509b73ee tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:28.652459 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-22d08b33-c859-4752-9ab4-d5a8509b73ee tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:28.652917 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-22d08b33-c859-4752-9ab4-d5a8509b73ee tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:28.653340 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-22d08b33-c859-4752-9ab4-d5a8509b73ee tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:28.847897 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-22d08b33-c859-4752-9ab4-d5a8509b73ee tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:28.855827 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-22d08b33-c859-4752-9ab4-d5a8509b73ee tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1371 microversion: 2.1 time: 0.215475 Aug 04 22:28:28.858155 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 424/847] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:28 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:28.926145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-d7857632-13f5-45bb-a467-a062b2ab283e req-29e6aaad-de8d-4efd-9282-2a0a181cd34b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5faeb98-3d13-42e3-ac27-274501489586", "tag": "de78c712-58d3-4973-b307-75b8ab84d687"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:28.929922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2323f52c-eeab-4123-b99a-88f556c2b723 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:28.930425 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2323f52c-eeab-4123-b99a-88f556c2b723 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:28.939414 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-d7857632-13f5-45bb-a467-a062b2ab283e req-29e6aaad-de8d-4efd-9282-2a0a181cd34b service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:28.939573 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2323f52c-eeab-4123-b99a-88f556c2b723 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:28.940043 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2323f52c-eeab-4123-b99a-88f556c2b723 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:28.940205 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-d7857632-13f5-45bb-a467-a062b2ab283e req-29e6aaad-de8d-4efd-9282-2a0a181cd34b service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:28.940631 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-d7857632-13f5-45bb-a467-a062b2ab283e req-29e6aaad-de8d-4efd-9282-2a0a181cd34b service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:28.941105 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2323f52c-eeab-4123-b99a-88f556c2b723 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:28.942330 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2323f52c-eeab-4123-b99a-88f556c2b723 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:28.942784 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2323f52c-eeab-4123-b99a-88f556c2b723 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:28.943383 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2323f52c-eeab-4123-b99a-88f556c2b723 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:28.953686 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-d7857632-13f5-45bb-a467-a062b2ab283e req-29e6aaad-de8d-4efd-9282-2a0a181cd34b service nova] Creating event network-changed:de78c712-58d3-4973-b307-75b8ab84d687 for instance b5faeb98-3d13-42e3-ac27-274501489586 on hv-cinder-85221 Aug 04 22:28:28.958996 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-d7857632-13f5-45bb-a467-a062b2ab283e req-29e6aaad-de8d-4efd-9282-2a0a181cd34b service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036942 Aug 04 22:28:28.959943 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 424/848] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:29.029930 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:29.034293 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.objects.instance [None req-2323f52c-eeab-4123-b99a-88f556c2b723 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lazy-loading 'services' on Instance uuid 5cca04a9-f894-43cf-b1d6-009292cdbcbb {{(pid=129197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:28:29.113123 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2323f52c-eeab-4123-b99a-88f556c2b723 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "DELETE /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-volume_attachments/e569f8d1-1b78-469c-a193-f3c2426d680f" status: 202 len: 0 microversion: 2.1 time: 0.186640 Aug 04 22:28:29.113611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 425/849] 10.222.0.109 () {58 vars in 1421 bytes} [Thu Aug 4 22:28:28 2022] DELETE /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-volume_attachments/e569f8d1-1b78-469c-a193-f3c2426d680f => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 22:28:29.123365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c976b58c-6ec8-4ed6-88b5-059d0936ec7d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:29.125678 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c976b58c-6ec8-4ed6-88b5-059d0936ec7d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:29.131923 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c976b58c-6ec8-4ed6-88b5-059d0936ec7d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:29.132419 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c976b58c-6ec8-4ed6-88b5-059d0936ec7d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:29.132836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c976b58c-6ec8-4ed6-88b5-059d0936ec7d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:29.133568 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c976b58c-6ec8-4ed6-88b5-059d0936ec7d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:29.134026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c976b58c-6ec8-4ed6-88b5-059d0936ec7d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:29.134451 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c976b58c-6ec8-4ed6-88b5-059d0936ec7d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:29.166561 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c976b58c-6ec8-4ed6-88b5-059d0936ec7d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048353 Aug 04 22:28:29.167113 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 425/850] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:28:29 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:29.268616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-149efca0-2a32-487a-b4f0-84633d4e8448 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:29.269308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-149efca0-2a32-487a-b4f0-84633d4e8448 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:29.275346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-149efca0-2a32-487a-b4f0-84633d4e8448 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:29.275826 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-149efca0-2a32-487a-b4f0-84633d4e8448 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:29.276254 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-149efca0-2a32-487a-b4f0-84633d4e8448 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:29.276939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-149efca0-2a32-487a-b4f0-84633d4e8448 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:29.277382 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-149efca0-2a32-487a-b4f0-84633d4e8448 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:29.277848 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-149efca0-2a32-487a-b4f0-84633d4e8448 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:29.410109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-149efca0-2a32-487a-b4f0-84633d4e8448 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:29.417528 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-149efca0-2a32-487a-b4f0-84633d4e8448 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.153095 Aug 04 22:28:29.418095 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 426/851] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:29 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:29.878415 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b74253f2-3cff-4873-b9f2-80baaf2f8df3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:29.879026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b74253f2-3cff-4873-b9f2-80baaf2f8df3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:29.884919 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b74253f2-3cff-4873-b9f2-80baaf2f8df3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:29.885390 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b74253f2-3cff-4873-b9f2-80baaf2f8df3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:29.885857 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b74253f2-3cff-4873-b9f2-80baaf2f8df3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:29.886542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b74253f2-3cff-4873-b9f2-80baaf2f8df3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:29.886992 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b74253f2-3cff-4873-b9f2-80baaf2f8df3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:29.887906 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b74253f2-3cff-4873-b9f2-80baaf2f8df3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:30.015672 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b74253f2-3cff-4873-b9f2-80baaf2f8df3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:30.023267 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b74253f2-3cff-4873-b9f2-80baaf2f8df3 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1371 microversion: 2.1 time: 0.148690 Aug 04 22:28:30.023836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 426/852] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:29 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:30.179124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b0530633-3b18-4755-9a5e-970dd64779ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:30.181366 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b0530633-3b18-4755-9a5e-970dd64779ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:30.187606 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b0530633-3b18-4755-9a5e-970dd64779ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:30.188088 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b0530633-3b18-4755-9a5e-970dd64779ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:30.188516 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b0530633-3b18-4755-9a5e-970dd64779ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:30.189202 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b0530633-3b18-4755-9a5e-970dd64779ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:30.189679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b0530633-3b18-4755-9a5e-970dd64779ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:30.190101 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b0530633-3b18-4755-9a5e-970dd64779ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:30.219123 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b0530633-3b18-4755-9a5e-970dd64779ee tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Aug 04 22:28:30.219681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 427/853] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:28:30 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:30.438444 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-017f60ae-ed77-4cb0-80ac-348657c0957a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:30.439051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-017f60ae-ed77-4cb0-80ac-348657c0957a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:30.444997 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-017f60ae-ed77-4cb0-80ac-348657c0957a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:30.445508 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-017f60ae-ed77-4cb0-80ac-348657c0957a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:30.445933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-017f60ae-ed77-4cb0-80ac-348657c0957a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:30.446621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-017f60ae-ed77-4cb0-80ac-348657c0957a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:30.447151 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-017f60ae-ed77-4cb0-80ac-348657c0957a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:30.447563 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-017f60ae-ed77-4cb0-80ac-348657c0957a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:30.465586 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:30.588882 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-017f60ae-ed77-4cb0-80ac-348657c0957a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:30.599831 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-017f60ae-ed77-4cb0-80ac-348657c0957a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.165512 Aug 04 22:28:30.600404 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 427/854] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:30 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:31.043824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e34facfb-dbf3-43e1-92ff-527d28906f8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:31.044440 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e34facfb-dbf3-43e1-92ff-527d28906f8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:31.050898 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e34facfb-dbf3-43e1-92ff-527d28906f8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:31.051435 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e34facfb-dbf3-43e1-92ff-527d28906f8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:31.051950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e34facfb-dbf3-43e1-92ff-527d28906f8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:31.052942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e34facfb-dbf3-43e1-92ff-527d28906f8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:31.053499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e34facfb-dbf3-43e1-92ff-527d28906f8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:31.054039 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e34facfb-dbf3-43e1-92ff-527d28906f8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:31.182968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e34facfb-dbf3-43e1-92ff-527d28906f8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:31.190989 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e34facfb-dbf3-43e1-92ff-527d28906f8e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1371 microversion: 2.1 time: 0.151123 Aug 04 22:28:31.191552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 428/855] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:31 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:31.231965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-03d82a2e-4ab2-490e-a4f9-5933c3149fb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:31.234185 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-03d82a2e-4ab2-490e-a4f9-5933c3149fb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:31.240489 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03d82a2e-4ab2-490e-a4f9-5933c3149fb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:31.240971 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03d82a2e-4ab2-490e-a4f9-5933c3149fb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:31.241421 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03d82a2e-4ab2-490e-a4f9-5933c3149fb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:31.242110 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03d82a2e-4ab2-490e-a4f9-5933c3149fb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:31.242558 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03d82a2e-4ab2-490e-a4f9-5933c3149fb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:31.242979 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03d82a2e-4ab2-490e-a4f9-5933c3149fb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:31.271359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-03d82a2e-4ab2-490e-a4f9-5933c3149fb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044074 Aug 04 22:28:31.271969 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 428/856] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:28:31 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 22:28:31.347675 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ffecb9e2-8f18-45c4-9b1e-04cee1314d5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:31.348179 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ffecb9e2-8f18-45c4-9b1e-04cee1314d5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:31.354428 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ffecb9e2-8f18-45c4-9b1e-04cee1314d5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:31.354913 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ffecb9e2-8f18-45c4-9b1e-04cee1314d5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:31.355352 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ffecb9e2-8f18-45c4-9b1e-04cee1314d5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:31.356043 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ffecb9e2-8f18-45c4-9b1e-04cee1314d5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:31.357053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ffecb9e2-8f18-45c4-9b1e-04cee1314d5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:31.357578 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ffecb9e2-8f18-45c4-9b1e-04cee1314d5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:31.382530 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ffecb9e2-8f18-45c4-9b1e-04cee1314d5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Going to try to terminate instance {{(pid=129197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:28:31.455685 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ffecb9e2-8f18-45c4-9b1e-04cee1314d5d tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "DELETE /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 204 len: 0 microversion: 2.1 time: 0.111501 Aug 04 22:28:31.456179 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 429/857] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:28:31 2022] DELETE /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:28:31.464096 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-54ba30d7-528d-45ef-b1f2-517156bc6629 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:31.464709 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-54ba30d7-528d-45ef-b1f2-517156bc6629 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:31.470710 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-54ba30d7-528d-45ef-b1f2-517156bc6629 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:31.471226 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-54ba30d7-528d-45ef-b1f2-517156bc6629 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:31.471666 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-54ba30d7-528d-45ef-b1f2-517156bc6629 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:31.472358 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-54ba30d7-528d-45ef-b1f2-517156bc6629 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:31.472816 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-54ba30d7-528d-45ef-b1f2-517156bc6629 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:31.473244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-54ba30d7-528d-45ef-b1f2-517156bc6629 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:31.601049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-54ba30d7-528d-45ef-b1f2-517156bc6629 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:31.609277 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-54ba30d7-528d-45ef-b1f2-517156bc6629 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1693 microversion: 2.1 time: 0.148993 Aug 04 22:28:31.609975 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 429/858] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:31 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1693 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:31.620745 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-12280f09-342e-486c-8ebe-1989b5ad45c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:31.621566 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-12280f09-342e-486c-8ebe-1989b5ad45c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:31.628322 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-12280f09-342e-486c-8ebe-1989b5ad45c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:31.628804 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-12280f09-342e-486c-8ebe-1989b5ad45c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:31.629239 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-12280f09-342e-486c-8ebe-1989b5ad45c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:31.629964 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-12280f09-342e-486c-8ebe-1989b5ad45c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:31.630419 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-12280f09-342e-486c-8ebe-1989b5ad45c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:31.630851 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-12280f09-342e-486c-8ebe-1989b5ad45c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:31.759429 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-12280f09-342e-486c-8ebe-1989b5ad45c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:31.767141 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-12280f09-342e-486c-8ebe-1989b5ad45c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.150641 Aug 04 22:28:31.767707 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 430/859] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:31 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:28:32.212287 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-389b6884-5d0d-4582-9be1-61389eea9623 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:32.212830 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-389b6884-5d0d-4582-9be1-61389eea9623 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:32.219386 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-389b6884-5d0d-4582-9be1-61389eea9623 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:32.219872 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-389b6884-5d0d-4582-9be1-61389eea9623 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:32.220311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-389b6884-5d0d-4582-9be1-61389eea9623 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:32.221000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-389b6884-5d0d-4582-9be1-61389eea9623 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:32.221482 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-389b6884-5d0d-4582-9be1-61389eea9623 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:32.221911 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-389b6884-5d0d-4582-9be1-61389eea9623 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:32.353250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-389b6884-5d0d-4582-9be1-61389eea9623 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:32.361913 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-389b6884-5d0d-4582-9be1-61389eea9623 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1371 microversion: 2.1 time: 0.153539 Aug 04 22:28:32.362480 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 430/860] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:32 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:32.630989 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6c954d43-81bd-4f12-94e4-a94d7a565607 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:32.631599 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6c954d43-81bd-4f12-94e4-a94d7a565607 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:32.639160 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6c954d43-81bd-4f12-94e4-a94d7a565607 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:32.640026 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6c954d43-81bd-4f12-94e4-a94d7a565607 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:32.640841 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6c954d43-81bd-4f12-94e4-a94d7a565607 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:32.642134 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6c954d43-81bd-4f12-94e4-a94d7a565607 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:32.642947 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6c954d43-81bd-4f12-94e4-a94d7a565607 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:32.643698 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6c954d43-81bd-4f12-94e4-a94d7a565607 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:32.781395 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6c954d43-81bd-4f12-94e4-a94d7a565607 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:32.788044 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8d104167-6b36-4ac4-ab3f-f7bd0ebe2114 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:32.788662 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8d104167-6b36-4ac4-ab3f-f7bd0ebe2114 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:32.789331 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6c954d43-81bd-4f12-94e4-a94d7a565607 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1693 microversion: 2.1 time: 0.162187 Aug 04 22:28:32.789936 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 431/861] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:32 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:32.795780 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8d104167-6b36-4ac4-ab3f-f7bd0ebe2114 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:32.796274 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8d104167-6b36-4ac4-ab3f-f7bd0ebe2114 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:32.796711 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8d104167-6b36-4ac4-ab3f-f7bd0ebe2114 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:32.797625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8d104167-6b36-4ac4-ab3f-f7bd0ebe2114 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:32.798287 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8d104167-6b36-4ac4-ab3f-f7bd0ebe2114 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:32.798911 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8d104167-6b36-4ac4-ab3f-f7bd0ebe2114 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:32.931773 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8d104167-6b36-4ac4-ab3f-f7bd0ebe2114 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:32.940563 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8d104167-6b36-4ac4-ab3f-f7bd0ebe2114 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.156337 Aug 04 22:28:32.941143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 431/862] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:32 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:28:33.382901 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-169ca7af-08b2-4c45-95f8-ac1673be7ea9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:33.383544 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-169ca7af-08b2-4c45-95f8-ac1673be7ea9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:33.389540 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-169ca7af-08b2-4c45-95f8-ac1673be7ea9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:33.390031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-169ca7af-08b2-4c45-95f8-ac1673be7ea9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:33.390470 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-169ca7af-08b2-4c45-95f8-ac1673be7ea9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:33.391172 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-169ca7af-08b2-4c45-95f8-ac1673be7ea9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:33.391627 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-169ca7af-08b2-4c45-95f8-ac1673be7ea9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:33.392054 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-169ca7af-08b2-4c45-95f8-ac1673be7ea9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:33.523366 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-169ca7af-08b2-4c45-95f8-ac1673be7ea9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:33.531644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-169ca7af-08b2-4c45-95f8-ac1673be7ea9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1371 microversion: 2.1 time: 0.152600 Aug 04 22:28:33.532213 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 432/863] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:33 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:33.811703 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-430ebeb5-dae0-4abf-b03f-77bb283b35be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:33.812276 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-430ebeb5-dae0-4abf-b03f-77bb283b35be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:33.818624 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-430ebeb5-dae0-4abf-b03f-77bb283b35be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:33.819111 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-430ebeb5-dae0-4abf-b03f-77bb283b35be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:33.819544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-430ebeb5-dae0-4abf-b03f-77bb283b35be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:33.820234 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-430ebeb5-dae0-4abf-b03f-77bb283b35be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:33.820689 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-430ebeb5-dae0-4abf-b03f-77bb283b35be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:33.821117 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-430ebeb5-dae0-4abf-b03f-77bb283b35be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:33.952441 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-430ebeb5-dae0-4abf-b03f-77bb283b35be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:33.960488 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-430ebeb5-dae0-4abf-b03f-77bb283b35be tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1693 microversion: 2.1 time: 0.153303 Aug 04 22:28:33.961002 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b9b55c17-6dbe-4a86-9a54-00263d411bda tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:33.961676 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b9b55c17-6dbe-4a86-9a54-00263d411bda tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:33.968148 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b9b55c17-6dbe-4a86-9a54-00263d411bda tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:33.968639 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b9b55c17-6dbe-4a86-9a54-00263d411bda tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:33.969073 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b9b55c17-6dbe-4a86-9a54-00263d411bda tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:33.969809 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b9b55c17-6dbe-4a86-9a54-00263d411bda tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:33.970268 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b9b55c17-6dbe-4a86-9a54-00263d411bda tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:33.970694 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b9b55c17-6dbe-4a86-9a54-00263d411bda tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:33.973660 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 432/864] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:33 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:34.108124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b9b55c17-6dbe-4a86-9a54-00263d411bda tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:34.116660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b9b55c17-6dbe-4a86-9a54-00263d411bda tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.159309 Aug 04 22:28:34.117239 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 433/865] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:33 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:28:34.187393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-5e3175b6-1f37-47c2-a682-aa245398ad72 req-eec6eee1-2009-45f4-ab2a-2de0e11b5437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd73ce87-41fe-4b81-9b4b-546962f70b2d", "name": "network-vif-plugged", "status": "completed", "tag": "568a695a-e288-47b9-b51b-cc0981c71810"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:34.197704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-5e3175b6-1f37-47c2-a682-aa245398ad72 req-eec6eee1-2009-45f4-ab2a-2de0e11b5437 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:34.198254 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-5e3175b6-1f37-47c2-a682-aa245398ad72 req-eec6eee1-2009-45f4-ab2a-2de0e11b5437 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:34.198688 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-5e3175b6-1f37-47c2-a682-aa245398ad72 req-eec6eee1-2009-45f4-ab2a-2de0e11b5437 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:34.209924 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-5e3175b6-1f37-47c2-a682-aa245398ad72 req-eec6eee1-2009-45f4-ab2a-2de0e11b5437 service nova] Creating event network-vif-plugged:568a695a-e288-47b9-b51b-cc0981c71810 for instance fd73ce87-41fe-4b81-9b4b-546962f70b2d on hv-cinder-85221 Aug 04 22:28:34.214644 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-5e3175b6-1f37-47c2-a682-aa245398ad72 req-eec6eee1-2009-45f4-ab2a-2de0e11b5437 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031214 Aug 04 22:28:34.215230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 433/866] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:34.552506 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f1026e0c-d0c1-4b1e-bb06-4e3e38b45bcc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:34.553114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f1026e0c-d0c1-4b1e-bb06-4e3e38b45bcc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:34.559099 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f1026e0c-d0c1-4b1e-bb06-4e3e38b45bcc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:34.559586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f1026e0c-d0c1-4b1e-bb06-4e3e38b45bcc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:34.560028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f1026e0c-d0c1-4b1e-bb06-4e3e38b45bcc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:34.560726 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f1026e0c-d0c1-4b1e-bb06-4e3e38b45bcc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:34.561183 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f1026e0c-d0c1-4b1e-bb06-4e3e38b45bcc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:34.561638 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f1026e0c-d0c1-4b1e-bb06-4e3e38b45bcc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:34.689478 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f1026e0c-d0c1-4b1e-bb06-4e3e38b45bcc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:34.697243 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f1026e0c-d0c1-4b1e-bb06-4e3e38b45bcc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1371 microversion: 2.1 time: 0.148515 Aug 04 22:28:34.699154 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 434/867] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:34 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:34.984296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a7c91310-eca0-428b-ad18-808e2bec32c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:34.985101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a7c91310-eca0-428b-ad18-808e2bec32c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:34.991290 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7c91310-eca0-428b-ad18-808e2bec32c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:34.991772 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7c91310-eca0-428b-ad18-808e2bec32c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:34.992208 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7c91310-eca0-428b-ad18-808e2bec32c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:34.992895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7c91310-eca0-428b-ad18-808e2bec32c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:34.993344 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7c91310-eca0-428b-ad18-808e2bec32c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:34.993799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7c91310-eca0-428b-ad18-808e2bec32c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:35.127237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a7c91310-eca0-428b-ad18-808e2bec32c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:35.134690 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a7c91310-eca0-428b-ad18-808e2bec32c6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1693 microversion: 2.1 time: 0.155597 Aug 04 22:28:35.135254 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 434/868] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:34 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:35.137589 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a49bed3d-1ba6-4524-833c-490d904df68a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:35.138549 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a49bed3d-1ba6-4524-833c-490d904df68a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:35.144139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a49bed3d-1ba6-4524-833c-490d904df68a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:35.144617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a49bed3d-1ba6-4524-833c-490d904df68a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:35.145044 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a49bed3d-1ba6-4524-833c-490d904df68a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:35.145759 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a49bed3d-1ba6-4524-833c-490d904df68a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:35.146215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a49bed3d-1ba6-4524-833c-490d904df68a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:35.146631 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a49bed3d-1ba6-4524-833c-490d904df68a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:35.279527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a49bed3d-1ba6-4524-833c-490d904df68a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:35.286911 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a49bed3d-1ba6-4524-833c-490d904df68a tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.153402 Aug 04 22:28:35.287478 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 435/869] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:35 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:28:35.719036 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1c80396a-a71b-4484-aa09-510cb920da9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:35.719657 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1c80396a-a71b-4484-aa09-510cb920da9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:35.725680 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1c80396a-a71b-4484-aa09-510cb920da9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:35.726164 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1c80396a-a71b-4484-aa09-510cb920da9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:35.726603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1c80396a-a71b-4484-aa09-510cb920da9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:35.727292 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1c80396a-a71b-4484-aa09-510cb920da9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:35.727747 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1c80396a-a71b-4484-aa09-510cb920da9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:35.728174 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1c80396a-a71b-4484-aa09-510cb920da9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:36.004813 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1c80396a-a71b-4484-aa09-510cb920da9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:36.012214 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1c80396a-a71b-4484-aa09-510cb920da9d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1371 microversion: 2.1 time: 0.297878 Aug 04 22:28:36.013442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 435/870] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:35 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:36.155623 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-736d01d3-5398-4a8c-b530-6ccea598ceeb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:36.156242 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-736d01d3-5398-4a8c-b530-6ccea598ceeb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:36.162642 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-736d01d3-5398-4a8c-b530-6ccea598ceeb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:36.163133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-736d01d3-5398-4a8c-b530-6ccea598ceeb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:36.163574 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-736d01d3-5398-4a8c-b530-6ccea598ceeb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:36.164312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-736d01d3-5398-4a8c-b530-6ccea598ceeb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:36.164773 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-736d01d3-5398-4a8c-b530-6ccea598ceeb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:36.165199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-736d01d3-5398-4a8c-b530-6ccea598ceeb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:36.235432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-04607e0d-9beb-41b2-b2d2-3fd59f54ce45 req-f85cbe99-5787-473a-989f-187490493445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5faeb98-3d13-42e3-ac27-274501489586", "name": "network-vif-plugged", "status": "completed", "tag": "de78c712-58d3-4973-b307-75b8ab84d687"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:36.245067 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-04607e0d-9beb-41b2-b2d2-3fd59f54ce45 req-f85cbe99-5787-473a-989f-187490493445 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:36.245586 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-04607e0d-9beb-41b2-b2d2-3fd59f54ce45 req-f85cbe99-5787-473a-989f-187490493445 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:36.246027 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-04607e0d-9beb-41b2-b2d2-3fd59f54ce45 req-f85cbe99-5787-473a-989f-187490493445 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:36.258615 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-04607e0d-9beb-41b2-b2d2-3fd59f54ce45 req-f85cbe99-5787-473a-989f-187490493445 service nova] Creating event network-vif-plugged:de78c712-58d3-4973-b307-75b8ab84d687 for instance b5faeb98-3d13-42e3-ac27-274501489586 on hv-cinder-85221 Aug 04 22:28:36.264187 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-04607e0d-9beb-41b2-b2d2-3fd59f54ce45 req-f85cbe99-5787-473a-989f-187490493445 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032547 Aug 04 22:28:36.264786 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 436/871] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:28:36.308629 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1b3c3b06-300f-41f8-a9f3-780da7578a99 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:36.309894 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1b3c3b06-300f-41f8-a9f3-780da7578a99 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:36.316578 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b3c3b06-300f-41f8-a9f3-780da7578a99 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:36.317075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b3c3b06-300f-41f8-a9f3-780da7578a99 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:36.317539 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b3c3b06-300f-41f8-a9f3-780da7578a99 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:36.318252 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b3c3b06-300f-41f8-a9f3-780da7578a99 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:36.318710 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b3c3b06-300f-41f8-a9f3-780da7578a99 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:36.319137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b3c3b06-300f-41f8-a9f3-780da7578a99 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:36.339638 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:36.359524 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=6 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:36.465165 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1b3c3b06-300f-41f8-a9f3-780da7578a99 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:36.472870 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1b3c3b06-300f-41f8-a9f3-780da7578a99 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.168420 Aug 04 22:28:36.473465 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 437/872] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:36 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:28:36.500828 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=6 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:36.572959 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-736d01d3-5398-4a8c-b530-6ccea598ceeb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:36.581233 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-736d01d3-5398-4a8c-b530-6ccea598ceeb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1693 microversion: 2.1 time: 0.429467 Aug 04 22:28:36.581839 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 436/873] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:36 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1693 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:37.034041 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4dedfd08-388a-45e1-9574-65344c1b2005 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:37.034570 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4dedfd08-388a-45e1-9574-65344c1b2005 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:37.040778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4dedfd08-388a-45e1-9574-65344c1b2005 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:37.041472 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4dedfd08-388a-45e1-9574-65344c1b2005 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:37.041905 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4dedfd08-388a-45e1-9574-65344c1b2005 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:37.042585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4dedfd08-388a-45e1-9574-65344c1b2005 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:37.043029 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4dedfd08-388a-45e1-9574-65344c1b2005 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:37.043448 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4dedfd08-388a-45e1-9574-65344c1b2005 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:37.171299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4dedfd08-388a-45e1-9574-65344c1b2005 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:37.179054 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4dedfd08-388a-45e1-9574-65344c1b2005 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1371 microversion: 2.1 time: 0.148945 Aug 04 22:28:37.179868 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 438/874] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:37 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:37.498028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-df401441-2c91-4c19-8965-71e77a3fd1df tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:37.502123 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-df401441-2c91-4c19-8965-71e77a3fd1df tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:37.506630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-df401441-2c91-4c19-8965-71e77a3fd1df tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:37.507124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-df401441-2c91-4c19-8965-71e77a3fd1df tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:37.507565 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-df401441-2c91-4c19-8965-71e77a3fd1df tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:37.508272 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-df401441-2c91-4c19-8965-71e77a3fd1df tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:37.508732 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-df401441-2c91-4c19-8965-71e77a3fd1df tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:37.509238 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-df401441-2c91-4c19-8965-71e77a3fd1df tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:37.603040 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-87c535ee-2651-4eee-bd17-3a34b5014cb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:37.603931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-87c535ee-2651-4eee-bd17-3a34b5014cb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:37.610887 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-87c535ee-2651-4eee-bd17-3a34b5014cb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:37.611391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-87c535ee-2651-4eee-bd17-3a34b5014cb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:37.611834 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-87c535ee-2651-4eee-bd17-3a34b5014cb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:37.612552 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-87c535ee-2651-4eee-bd17-3a34b5014cb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:37.613363 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-87c535ee-2651-4eee-bd17-3a34b5014cb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:37.613612 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-87c535ee-2651-4eee-bd17-3a34b5014cb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:37.647134 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-df401441-2c91-4c19-8965-71e77a3fd1df tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:37.655721 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-df401441-2c91-4c19-8965-71e77a3fd1df tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.163990 Aug 04 22:28:37.656295 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 437/875] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:37 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:38.052890 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-87c535ee-2651-4eee-bd17-3a34b5014cb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:38.060400 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-87c535ee-2651-4eee-bd17-3a34b5014cb5 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1693 microversion: 2.1 time: 0.461352 Aug 04 22:28:38.062761 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 439/876] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:37 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1693 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:38.201076 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9129c1b6-df40-4542-a964-a83405af59d8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:38.201763 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-9129c1b6-df40-4542-a964-a83405af59d8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:38.207878 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9129c1b6-df40-4542-a964-a83405af59d8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:38.208366 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9129c1b6-df40-4542-a964-a83405af59d8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:38.208803 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9129c1b6-df40-4542-a964-a83405af59d8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:38.209595 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9129c1b6-df40-4542-a964-a83405af59d8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:38.209993 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9129c1b6-df40-4542-a964-a83405af59d8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:38.210423 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9129c1b6-df40-4542-a964-a83405af59d8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:38.344956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9129c1b6-df40-4542-a964-a83405af59d8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:38.353929 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9129c1b6-df40-4542-a964-a83405af59d8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1371 microversion: 2.1 time: 0.157271 Aug 04 22:28:38.355083 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 438/877] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:38 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:38.393996 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-0cdf3662-9a56-4cff-8353-a1f3de720abc req-7ba90ee4-9687-4390-a0ba-578b8c7f3cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cca04a9-f894-43cf-b1d6-009292cdbcbb", "name": "network-vif-deleted", "tag": "12d64262-0acf-4b1f-8905-8c5d540e11ec"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:38.403548 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-0cdf3662-9a56-4cff-8353-a1f3de720abc req-7ba90ee4-9687-4390-a0ba-578b8c7f3cf3 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:38.404030 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-0cdf3662-9a56-4cff-8353-a1f3de720abc req-7ba90ee4-9687-4390-a0ba-578b8c7f3cf3 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:38.404466 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-0cdf3662-9a56-4cff-8353-a1f3de720abc req-7ba90ee4-9687-4390-a0ba-578b8c7f3cf3 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:38.415319 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-0cdf3662-9a56-4cff-8353-a1f3de720abc req-7ba90ee4-9687-4390-a0ba-578b8c7f3cf3 service nova] Creating event network-vif-deleted:12d64262-0acf-4b1f-8905-8c5d540e11ec for instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb on hv-cinder-85221 Aug 04 22:28:38.420705 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-0cdf3662-9a56-4cff-8353-a1f3de720abc req-7ba90ee4-9687-4390-a0ba-578b8c7f3cf3 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030259 Aug 04 22:28:38.421298 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 440/878] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:38.676915 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9aca7344-7362-4ac4-aef8-0f4dcc95349f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:38.677610 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-9aca7344-7362-4ac4-aef8-0f4dcc95349f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:38.683512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9aca7344-7362-4ac4-aef8-0f4dcc95349f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:38.684502 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9aca7344-7362-4ac4-aef8-0f4dcc95349f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:38.684934 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9aca7344-7362-4ac4-aef8-0f4dcc95349f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:38.685669 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9aca7344-7362-4ac4-aef8-0f4dcc95349f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:38.686119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9aca7344-7362-4ac4-aef8-0f4dcc95349f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:38.686534 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9aca7344-7362-4ac4-aef8-0f4dcc95349f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:38.826525 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9aca7344-7362-4ac4-aef8-0f4dcc95349f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:38.834037 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9aca7344-7362-4ac4-aef8-0f4dcc95349f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.161049 Aug 04 22:28:38.834611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 439/879] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:38 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:39.084598 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a137d8f9-47c7-4178-9e27-27e6c3589ef6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:39.085291 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a137d8f9-47c7-4178-9e27-27e6c3589ef6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:39.092288 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a137d8f9-47c7-4178-9e27-27e6c3589ef6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:39.092767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a137d8f9-47c7-4178-9e27-27e6c3589ef6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:39.093199 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a137d8f9-47c7-4178-9e27-27e6c3589ef6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:39.093914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a137d8f9-47c7-4178-9e27-27e6c3589ef6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:39.094365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a137d8f9-47c7-4178-9e27-27e6c3589ef6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:39.094787 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a137d8f9-47c7-4178-9e27-27e6c3589ef6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:39.162624 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a137d8f9-47c7-4178-9e27-27e6c3589ef6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:39.171677 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a137d8f9-47c7-4178-9e27-27e6c3589ef6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1333 microversion: 2.1 time: 0.091206 Aug 04 22:28:39.172262 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 441/880] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:39 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:39.374351 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ec240de8-607e-4147-9df2-29a8b87bcc4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:39.375151 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ec240de8-607e-4147-9df2-29a8b87bcc4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:39.381426 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ec240de8-607e-4147-9df2-29a8b87bcc4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:39.381963 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ec240de8-607e-4147-9df2-29a8b87bcc4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:39.382403 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ec240de8-607e-4147-9df2-29a8b87bcc4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:39.383125 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ec240de8-607e-4147-9df2-29a8b87bcc4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:39.383582 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ec240de8-607e-4147-9df2-29a8b87bcc4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:39.384003 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ec240de8-607e-4147-9df2-29a8b87bcc4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:39.388923 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:39.524900 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ec240de8-607e-4147-9df2-29a8b87bcc4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:39.533384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ec240de8-607e-4147-9df2-29a8b87bcc4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1561 microversion: 2.1 time: 0.162946 Aug 04 22:28:39.534018 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 440/881] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:39 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:39.555381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b94a64be-7082-4e44-b118-d0e3453593ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:39.555876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b94a64be-7082-4e44-b118-d0e3453593ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:39.562563 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b94a64be-7082-4e44-b118-d0e3453593ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:39.563042 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b94a64be-7082-4e44-b118-d0e3453593ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:39.563471 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b94a64be-7082-4e44-b118-d0e3453593ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:39.564167 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b94a64be-7082-4e44-b118-d0e3453593ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:39.564613 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b94a64be-7082-4e44-b118-d0e3453593ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:39.565034 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b94a64be-7082-4e44-b118-d0e3453593ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:39.644662 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b94a64be-7082-4e44-b118-d0e3453593ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093897 Aug 04 22:28:39.645250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 442/882] 10.222.0.109 () {58 vars in 1280 bytes} [Thu Aug 4 22:28:39 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:28:39.857922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3d3e0196-f5b7-49b5-bc67-3732e38e47e6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:39.858547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3d3e0196-f5b7-49b5-bc67-3732e38e47e6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:39.865832 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3d3e0196-f5b7-49b5-bc67-3732e38e47e6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:39.866433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3d3e0196-f5b7-49b5-bc67-3732e38e47e6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:39.866930 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3d3e0196-f5b7-49b5-bc67-3732e38e47e6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:39.867667 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3d3e0196-f5b7-49b5-bc67-3732e38e47e6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:39.868130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3d3e0196-f5b7-49b5-bc67-3732e38e47e6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:39.868559 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3d3e0196-f5b7-49b5-bc67-3732e38e47e6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:40.020095 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3d3e0196-f5b7-49b5-bc67-3732e38e47e6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:40.029041 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3d3e0196-f5b7-49b5-bc67-3732e38e47e6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1263 microversion: 2.1 time: 0.177470 Aug 04 22:28:40.029763 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 441/883] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:39 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:40.192490 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:40.193088 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:40.198873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:40.199358 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:40.199829 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:40.200524 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:40.200980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:40.201429 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:40.234376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:40.234801 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:40.235241 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:40.235687 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lazy-loading 'fault' on Instance uuid 5cca04a9-f894-43cf-b1d6-009292cdbcbb {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:28:40.309342 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:40.316815 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3dad82b1-8895-41c2-b6f4-ed5b3d4ab8ed tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 200 len: 1338 microversion: 2.1 time: 0.128593 Aug 04 22:28:40.317387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 443/884] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:40 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 1338 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:40.612469 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-c563bf98-f798-46be-a526-ce444cf678e7 req-8e6a0fe7-0a66-466c-84c4-7ab16e9e777a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5faeb98-3d13-42e3-ac27-274501489586", "tag": "de78c712-58d3-4973-b307-75b8ab84d687"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:40.622815 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c563bf98-f798-46be-a526-ce444cf678e7 req-8e6a0fe7-0a66-466c-84c4-7ab16e9e777a service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:40.623383 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c563bf98-f798-46be-a526-ce444cf678e7 req-8e6a0fe7-0a66-466c-84c4-7ab16e9e777a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:40.624230 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c563bf98-f798-46be-a526-ce444cf678e7 req-8e6a0fe7-0a66-466c-84c4-7ab16e9e777a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:40.636523 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-c563bf98-f798-46be-a526-ce444cf678e7 req-8e6a0fe7-0a66-466c-84c4-7ab16e9e777a service nova] Creating event network-changed:de78c712-58d3-4973-b307-75b8ab84d687 for instance b5faeb98-3d13-42e3-ac27-274501489586 on hv-cinder-85221 Aug 04 22:28:40.643094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-c563bf98-f798-46be-a526-ce444cf678e7 req-8e6a0fe7-0a66-466c-84c4-7ab16e9e777a service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034235 Aug 04 22:28:40.643999 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 442/885] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:41.058324 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9895b80e-81a1-4f57-8440-5aedaae51750 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:41.060452 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9895b80e-81a1-4f57-8440-5aedaae51750 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:41.071667 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9895b80e-81a1-4f57-8440-5aedaae51750 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:41.072462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9895b80e-81a1-4f57-8440-5aedaae51750 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:41.073077 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9895b80e-81a1-4f57-8440-5aedaae51750 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:41.074067 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9895b80e-81a1-4f57-8440-5aedaae51750 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:41.075603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9895b80e-81a1-4f57-8440-5aedaae51750 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:41.076176 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9895b80e-81a1-4f57-8440-5aedaae51750 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:41.284798 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9895b80e-81a1-4f57-8440-5aedaae51750 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:41.293390 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9895b80e-81a1-4f57-8440-5aedaae51750 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1448 microversion: 2.1 time: 0.246523 Aug 04 22:28:41.294070 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 444/886] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:41 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1448 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:41.314760 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-345c2919-3d8b-4c05-93b0-174bef8f79ec tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:41.315525 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-345c2919-3d8b-4c05-93b0-174bef8f79ec tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:41.321685 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-345c2919-3d8b-4c05-93b0-174bef8f79ec tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:41.322170 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-345c2919-3d8b-4c05-93b0-174bef8f79ec tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:41.322600 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-345c2919-3d8b-4c05-93b0-174bef8f79ec tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:41.323290 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-345c2919-3d8b-4c05-93b0-174bef8f79ec tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:41.323740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-345c2919-3d8b-4c05-93b0-174bef8f79ec tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:41.324158 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-345c2919-3d8b-4c05-93b0-174bef8f79ec tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:41.338087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9578fc78-cc4d-4779-b551-b132cf6cfedb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:41.338982 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9578fc78-cc4d-4779-b551-b132cf6cfedb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 5cca04a9-f894-43cf-b1d6-009292cdbcbb] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:41.346102 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9578fc78-cc4d-4779-b551-b132cf6cfedb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:41.346811 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9578fc78-cc4d-4779-b551-b132cf6cfedb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:41.347416 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9578fc78-cc4d-4779-b551-b132cf6cfedb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:41.348298 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9578fc78-cc4d-4779-b551-b132cf6cfedb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:41.348903 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9578fc78-cc4d-4779-b551-b132cf6cfedb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:41.349519 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9578fc78-cc4d-4779-b551-b132cf6cfedb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:41.365185 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-9578fc78-cc4d-4779-b551-b132cf6cfedb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] HTTP exception thrown: Instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb could not be found. Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9578fc78-cc4d-4779-b551-b132cf6cfedb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Request method failure captured: Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb HTTP/1.1 Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYrBl6iVSsbeUBGuNUsCrcR_k9iol3MjGtflczYOd1VVWaNljGEka8fyS_szpgwEG027Pb-gXKzAyoPcqSTNny01b2nKUjZVmNL3L-UuiR2ay4JqGJewr8wM744kJa6rrGR2Z06pY_jnaOVvdsETxhEF674NYDOdgIbxMjU0W1UhHg Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 5116986e2edc4b5c92da0b77a497910a Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:28:41.367118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:28:41.368751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/5116986e2edc4b5c92da0b77a497910a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_5116986e2edc4b5c92da0b77a497910a", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/5116986e2edc4b5c92da0b77a497910a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/5116986e2edc4b5c92da0b77a497910a"}]}] Aug 04 22:28:41.368751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:28:41.368751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 5116986e2edc4b5c92da0b77a497910a Aug 04 22:28:41.368751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:28:41.368751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-ServerRescueNegativeTestJSON-1760242217-project Aug 04 22:28:41.368751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:28:41.368751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:28:41.368751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: f3dab07011da408c97ed90d58f2c155b Aug 04 22:28:41.368751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1760242217-project Aug 04 22:28:41.368751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:28:41.368751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb could not be found. Aug 04 22:28:41.368751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': '5cca04a9-f894-43cf-b1d6-009292cdbcbb'} Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb could not be found. Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:28:41.369588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb could not be found. Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb could not be found. Aug 04 22:28:41.371087 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:41.374389 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9578fc78-cc4d-4779-b551-b132cf6cfedb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Returning 404 to user: Instance 5cca04a9-f894-43cf-b1d6-009292cdbcbb could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:28:41.375407 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9578fc78-cc4d-4779-b551-b132cf6cfedb tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb" status: 404 len: 111 microversion: 2.1 time: 0.041181 Aug 04 22:28:41.376468 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 445/887] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:41 2022] GET /compute/v2.1/servers/5cca04a9-f894-43cf-b1d6-009292cdbcbb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 22:28:41.386620 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-db272189-e978-4480-a659-666797e3e9e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '.version_select at 0x7fe7b1696160>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:41.412828 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-db272189-e978-4480-a659-666797e3e9e6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-781171814" status: 202 len: 0 microversion: 2.1 time: 0.031582 Aug 04 22:28:41.413784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 446/888] 10.222.0.109 () {58 vars in 1223 bytes} [Thu Aug 4 22:28:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-781171814 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 22:28:41.488962 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-345c2919-3d8b-4c05-93b0-174bef8f79ec tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:41.497432 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-345c2919-3d8b-4c05-93b0-174bef8f79ec tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1448 microversion: 2.1 time: 0.187145 Aug 04 22:28:41.498028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 443/889] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:41 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1448 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:43.650044 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-a5e6e524-5b36-44e7-b6da-5a6cb3e017c2 req-5cc0c01c-89cb-4f91-847b-c83c8cb4a178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd73ce87-41fe-4b81-9b4b-546962f70b2d", "tag": "568a695a-e288-47b9-b51b-cc0981c71810"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:43.661179 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a5e6e524-5b36-44e7-b6da-5a6cb3e017c2 req-5cc0c01c-89cb-4f91-847b-c83c8cb4a178 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:43.661791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a5e6e524-5b36-44e7-b6da-5a6cb3e017c2 req-5cc0c01c-89cb-4f91-847b-c83c8cb4a178 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:43.662288 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a5e6e524-5b36-44e7-b6da-5a6cb3e017c2 req-5cc0c01c-89cb-4f91-847b-c83c8cb4a178 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:43.673012 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-a5e6e524-5b36-44e7-b6da-5a6cb3e017c2 req-5cc0c01c-89cb-4f91-847b-c83c8cb4a178 service nova] Creating event network-changed:568a695a-e288-47b9-b51b-cc0981c71810 for instance fd73ce87-41fe-4b81-9b4b-546962f70b2d on hv-cinder-85221 Aug 04 22:28:43.680866 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-a5e6e524-5b36-44e7-b6da-5a6cb3e017c2 req-5cc0c01c-89cb-4f91-847b-c83c8cb4a178 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034107 Aug 04 22:28:43.681668 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 447/890] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:44.805344 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3b91d2d1-270a-4759-9565-f25d0b950c90 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:44.805880 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3b91d2d1-270a-4759-9565-f25d0b950c90 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:44.812733 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3b91d2d1-270a-4759-9565-f25d0b950c90 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:44.813216 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3b91d2d1-270a-4759-9565-f25d0b950c90 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:44.813682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3b91d2d1-270a-4759-9565-f25d0b950c90 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:44.814400 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3b91d2d1-270a-4759-9565-f25d0b950c90 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:44.814861 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3b91d2d1-270a-4759-9565-f25d0b950c90 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:44.815287 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3b91d2d1-270a-4759-9565-f25d0b950c90 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:44.838806 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3b91d2d1-270a-4759-9565-f25d0b950c90 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Going to try to terminate instance {{(pid=129197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:28:44.911854 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3b91d2d1-270a-4759-9565-f25d0b950c90 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "DELETE /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 204 len: 0 microversion: 2.1 time: 0.110037 Aug 04 22:28:44.912679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 444/891] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:28:44 2022] DELETE /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:28:44.921766 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-dc72ebb9-6eff-4286-9498-7b5ceec522b0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:44.922479 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-dc72ebb9-6eff-4286-9498-7b5ceec522b0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:44.928991 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc72ebb9-6eff-4286-9498-7b5ceec522b0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:44.929438 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc72ebb9-6eff-4286-9498-7b5ceec522b0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:44.929871 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc72ebb9-6eff-4286-9498-7b5ceec522b0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:44.930550 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc72ebb9-6eff-4286-9498-7b5ceec522b0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:44.931000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc72ebb9-6eff-4286-9498-7b5ceec522b0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:44.931419 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc72ebb9-6eff-4286-9498-7b5ceec522b0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:44.952011 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:45.062422 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-dc72ebb9-6eff-4286-9498-7b5ceec522b0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:45.069792 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-dc72ebb9-6eff-4286-9498-7b5ceec522b0 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1512 microversion: 2.1 time: 0.152873 Aug 04 22:28:45.070343 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 448/892] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:44 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:46.091636 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-903811b2-75d4-4a96-89d1-df5d6df868af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:46.092457 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-903811b2-75d4-4a96-89d1-df5d6df868af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:46.098296 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-903811b2-75d4-4a96-89d1-df5d6df868af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:46.098780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-903811b2-75d4-4a96-89d1-df5d6df868af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:46.099218 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-903811b2-75d4-4a96-89d1-df5d6df868af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:46.099911 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-903811b2-75d4-4a96-89d1-df5d6df868af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:46.100362 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-903811b2-75d4-4a96-89d1-df5d6df868af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:46.100783 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-903811b2-75d4-4a96-89d1-df5d6df868af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:46.240479 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-903811b2-75d4-4a96-89d1-df5d6df868af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:46.249846 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-903811b2-75d4-4a96-89d1-df5d6df868af tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 200 len: 1512 microversion: 2.1 time: 0.162748 Aug 04 22:28:46.250785 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 445/893] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:46 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:46.290781 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-ebf4314b-8b7f-499b-adba-4a55158ef4cd req-409d995c-27cd-4d54-901e-e9ea8ead8c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33083aef-a898-484c-9060-827392ed18bc", "name": "network-vif-deleted", "tag": "dce2fd0b-8452-4b56-810e-62ae9cf27a28"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:46.302999 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-ebf4314b-8b7f-499b-adba-4a55158ef4cd req-409d995c-27cd-4d54-901e-e9ea8ead8c7d service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:46.303483 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-ebf4314b-8b7f-499b-adba-4a55158ef4cd req-409d995c-27cd-4d54-901e-e9ea8ead8c7d service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:46.303937 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-ebf4314b-8b7f-499b-adba-4a55158ef4cd req-409d995c-27cd-4d54-901e-e9ea8ead8c7d service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:46.316025 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-ebf4314b-8b7f-499b-adba-4a55158ef4cd req-409d995c-27cd-4d54-901e-e9ea8ead8c7d service nova] Creating event network-vif-deleted:dce2fd0b-8452-4b56-810e-62ae9cf27a28 for instance 33083aef-a898-484c-9060-827392ed18bc on hv-cinder-85221 Aug 04 22:28:46.321744 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-ebf4314b-8b7f-499b-adba-4a55158ef4cd req-409d995c-27cd-4d54-901e-e9ea8ead8c7d service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034627 Aug 04 22:28:46.322614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 449/894] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:47.272058 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b1ca3e3e-351a-46c6-9b4c-4afbf8b7baf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:47.272592 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b1ca3e3e-351a-46c6-9b4c-4afbf8b7baf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 33083aef-a898-484c-9060-827392ed18bc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:47.279379 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1ca3e3e-351a-46c6-9b4c-4afbf8b7baf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:47.279865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1ca3e3e-351a-46c6-9b4c-4afbf8b7baf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:47.280295 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1ca3e3e-351a-46c6-9b4c-4afbf8b7baf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:47.281043 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1ca3e3e-351a-46c6-9b4c-4afbf8b7baf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:47.281527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1ca3e3e-351a-46c6-9b4c-4afbf8b7baf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:47.281950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1ca3e3e-351a-46c6-9b4c-4afbf8b7baf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:47.295396 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-b1ca3e3e-351a-46c6-9b4c-4afbf8b7baf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] HTTP exception thrown: Instance 33083aef-a898-484c-9060-827392ed18bc could not be found. Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b1ca3e3e-351a-46c6-9b4c-4afbf8b7baf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Request method failure captured: Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc HTTP/1.1 Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYrBl6iVSsbeUBGuNUsCrcR_k9iol3MjGtflczYOd1VVWaNljGEka8fyS_szpgwEG027Pb-gXKzAyoPcqSTNny01b2nKUjZVmNL3L-UuiR2ay4JqGJewr8wM744kJa6rrGR2Z06pY_jnaOVvdsETxhEF674NYDOdgIbxMjU0W1UhHg Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 5116986e2edc4b5c92da0b77a497910a Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:28:47.296998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:28:47.298587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/5116986e2edc4b5c92da0b77a497910a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_5116986e2edc4b5c92da0b77a497910a", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/5116986e2edc4b5c92da0b77a497910a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/5116986e2edc4b5c92da0b77a497910a"}]}] Aug 04 22:28:47.298587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:28:47.298587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 5116986e2edc4b5c92da0b77a497910a Aug 04 22:28:47.298587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:28:47.298587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-ServerRescueNegativeTestJSON-1760242217-project Aug 04 22:28:47.298587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:28:47.298587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:28:47.298587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: f3dab07011da408c97ed90d58f2c155b Aug 04 22:28:47.298587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1760242217-project Aug 04 22:28:47.298587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:28:47.298587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance 33083aef-a898-484c-9060-827392ed18bc could not be found. Aug 04 22:28:47.298587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '33083aef-a898-484c-9060-827392ed18bc'} Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33083aef-a898-484c-9060-827392ed18bc could not be found. Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:28:47.299488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33083aef-a898-484c-9060-827392ed18bc could not be found. Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33083aef-a898-484c-9060-827392ed18bc could not be found. Aug 04 22:28:47.300926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:28:47.302324 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b1ca3e3e-351a-46c6-9b4c-4afbf8b7baf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Returning 404 to user: Instance 33083aef-a898-484c-9060-827392ed18bc could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:28:47.302324 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b1ca3e3e-351a-46c6-9b4c-4afbf8b7baf6 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc" status: 404 len: 111 microversion: 2.1 time: 0.030607 Aug 04 22:28:47.302324 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 446/895] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:47 2022] GET /compute/v2.1/servers/33083aef-a898-484c-9060-827392ed18bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:28:47.308266 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9f9167a7-63f1-4ace-8741-b5cbd335b411 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:47.309217 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9f9167a7-63f1-4ace-8741-b5cbd335b411 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:47.315066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f9167a7-63f1-4ace-8741-b5cbd335b411 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:47.315654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f9167a7-63f1-4ace-8741-b5cbd335b411 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:47.316107 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f9167a7-63f1-4ace-8741-b5cbd335b411 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:47.316801 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f9167a7-63f1-4ace-8741-b5cbd335b411 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:47.317259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f9167a7-63f1-4ace-8741-b5cbd335b411 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:47.317736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9f9167a7-63f1-4ace-8741-b5cbd335b411 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:47.342837 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9f9167a7-63f1-4ace-8741-b5cbd335b411 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Going to try to terminate instance {{(pid=129196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:28:47.415702 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9f9167a7-63f1-4ace-8741-b5cbd335b411 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "DELETE /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 204 len: 0 microversion: 2.1 time: 0.111904 Aug 04 22:28:47.416278 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 450/896] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:28:47 2022] DELETE /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:28:47.424692 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-85686994-f9f6-4819-832f-c36ceb3cb084 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:47.425303 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-85686994-f9f6-4819-832f-c36ceb3cb084 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:47.431180 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-85686994-f9f6-4819-832f-c36ceb3cb084 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:47.431728 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-85686994-f9f6-4819-832f-c36ceb3cb084 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:47.432161 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-85686994-f9f6-4819-832f-c36ceb3cb084 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:47.432890 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-85686994-f9f6-4819-832f-c36ceb3cb084 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:47.433889 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-85686994-f9f6-4819-832f-c36ceb3cb084 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:47.434312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-85686994-f9f6-4819-832f-c36ceb3cb084 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:47.568775 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-85686994-f9f6-4819-832f-c36ceb3cb084 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:47.577756 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-85686994-f9f6-4819-832f-c36ceb3cb084 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1526 microversion: 2.1 time: 0.156888 Aug 04 22:28:47.578330 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 447/897] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:47 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:28:48.599278 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4ad116b4-79e1-4fbc-8538-d5435648badd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:48.600059 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4ad116b4-79e1-4fbc-8538-d5435648badd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:48.608921 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4ad116b4-79e1-4fbc-8538-d5435648badd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:48.609993 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4ad116b4-79e1-4fbc-8538-d5435648badd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:48.610882 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4ad116b4-79e1-4fbc-8538-d5435648badd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:48.612248 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4ad116b4-79e1-4fbc-8538-d5435648badd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:48.613162 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4ad116b4-79e1-4fbc-8538-d5435648badd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:48.614072 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4ad116b4-79e1-4fbc-8538-d5435648badd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:48.726018 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4ad116b4-79e1-4fbc-8538-d5435648badd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3dab07011da408c97ed90d58f2c155b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5116986e2edc4b5c92da0b77a497910a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:28:48.733792 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4ad116b4-79e1-4fbc-8538-d5435648badd tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 200 len: 1484 microversion: 2.1 time: 0.138669 Aug 04 22:28:48.734375 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 451/898] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:48 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 1484 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:28:48.758689 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-05cfb71c-9623-4c4b-99c1-1f243e6b401d req-c5f5bb48-4c7d-49a1-ba0e-22cefc8566d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6318eb70-fdcf-4545-b737-61e032221d53", "name": "network-vif-deleted", "tag": "39cb006e-1fc6-41fe-8b9f-b8a5c87f0721"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:48.769092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-05cfb71c-9623-4c4b-99c1-1f243e6b401d req-c5f5bb48-4c7d-49a1-ba0e-22cefc8566d5 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:48.769618 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-05cfb71c-9623-4c4b-99c1-1f243e6b401d req-c5f5bb48-4c7d-49a1-ba0e-22cefc8566d5 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:48.770053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-05cfb71c-9623-4c4b-99c1-1f243e6b401d req-c5f5bb48-4c7d-49a1-ba0e-22cefc8566d5 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:48.782032 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-05cfb71c-9623-4c4b-99c1-1f243e6b401d req-c5f5bb48-4c7d-49a1-ba0e-22cefc8566d5 service nova] Creating event network-vif-deleted:39cb006e-1fc6-41fe-8b9f-b8a5c87f0721 for instance 6318eb70-fdcf-4545-b737-61e032221d53 on hv-cinder-85221 Aug 04 22:28:48.786760 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-05cfb71c-9623-4c4b-99c1-1f243e6b401d req-c5f5bb48-4c7d-49a1-ba0e-22cefc8566d5 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031992 Aug 04 22:28:48.787371 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 448/899] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:49.754882 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c58e65f8-61ef-4278-9f04-1c9d01286493 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:28:49.755516 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c58e65f8-61ef-4278-9f04-1c9d01286493 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] [instance: 6318eb70-fdcf-4545-b737-61e032221d53] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:28:49.759046 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:49.763228 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c58e65f8-61ef-4278-9f04-1c9d01286493 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:49.763712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c58e65f8-61ef-4278-9f04-1c9d01286493 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:49.764146 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c58e65f8-61ef-4278-9f04-1c9d01286493 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:49.764834 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c58e65f8-61ef-4278-9f04-1c9d01286493 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:28:49.765287 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c58e65f8-61ef-4278-9f04-1c9d01286493 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:28:49.765742 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c58e65f8-61ef-4278-9f04-1c9d01286493 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:28:49.781644 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-c58e65f8-61ef-4278-9f04-1c9d01286493 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] HTTP exception thrown: Instance 6318eb70-fdcf-4545-b737-61e032221d53 could not be found. Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c58e65f8-61ef-4278-9f04-1c9d01286493 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Request method failure captured: Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 HTTP/1.1 Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYrBl6iVSsbeUBGuNUsCrcR_k9iol3MjGtflczYOd1VVWaNljGEka8fyS_szpgwEG027Pb-gXKzAyoPcqSTNny01b2nKUjZVmNL3L-UuiR2ay4JqGJewr8wM744kJa6rrGR2Z06pY_jnaOVvdsETxhEF674NYDOdgIbxMjU0W1UhHg Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 5116986e2edc4b5c92da0b77a497910a Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:28:49.783351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:28:49.784895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/5116986e2edc4b5c92da0b77a497910a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_5116986e2edc4b5c92da0b77a497910a", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/5116986e2edc4b5c92da0b77a497910a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/5116986e2edc4b5c92da0b77a497910a"}]}] Aug 04 22:28:49.784895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:28:49.784895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 5116986e2edc4b5c92da0b77a497910a Aug 04 22:28:49.784895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1760242217 Aug 04 22:28:49.784895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-ServerRescueNegativeTestJSON-1760242217-project Aug 04 22:28:49.784895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:28:49.784895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:28:49.784895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: f3dab07011da408c97ed90d58f2c155b Aug 04 22:28:49.784895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1760242217-project Aug 04 22:28:49.784895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:28:49.784895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance 6318eb70-fdcf-4545-b737-61e032221d53 could not be found. Aug 04 22:28:49.784895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': '6318eb70-fdcf-4545-b737-61e032221d53'} Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6318eb70-fdcf-4545-b737-61e032221d53 could not be found. Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:28:49.785824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6318eb70-fdcf-4545-b737-61e032221d53 could not be found. Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6318eb70-fdcf-4545-b737-61e032221d53 could not be found. Aug 04 22:28:49.787066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:28:49.788148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c58e65f8-61ef-4278-9f04-1c9d01286493 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] Returning 404 to user: Instance 6318eb70-fdcf-4545-b737-61e032221d53 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:28:49.788148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c58e65f8-61ef-4278-9f04-1c9d01286493 tempest-ServerRescueNegativeTestJSON-1760242217 tempest-ServerRescueNegativeTestJSON-1760242217-project] 10.222.0.109 "GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53" status: 404 len: 111 microversion: 2.1 time: 0.033676 Aug 04 22:28:49.788148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 452/900] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:28:49 2022] GET /compute/v2.1/servers/6318eb70-fdcf-4545-b737-61e032221d53 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:28:58.527118 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-dbe2c51a-360c-4af1-80c2-f5c87ae14f6b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Action: 'create', calling method: .version_select at 0x7fe7b17a4310>, body: {"keypair": {"name": "tempest-keypair-1786916654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqoir5alPBm+vLmqjt2OIlYHhUTZXVlRAZwQ2c6Ki9+UtxdcoMDYZ8r19DVLW2j8jAY8LgY5y0ZvMtgsSozwq7dPVwwqupP0qW3zqDtsre1PP4/eO4PCQHU7KjSn1MY9A=="}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:58.532655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:58.545246 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-dbe2c51a-360c-4af1-80c2-f5c87ae14f6b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Getting quotas for project 477c661a08dd46b2a20f53a7944361ef. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:28:58.549876 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-dbe2c51a-360c-4af1-80c2-f5c87ae14f6b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Getting quotas for user 890f3e80ae37401f8dad15d3d084f091 and project 477c661a08dd46b2a20f53a7944361ef. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:28:58.578083 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-dbe2c51a-360c-4af1-80c2-f5c87ae14f6b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.245376 Aug 04 22:28:58.578681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 449/901] 10.222.0.109 () {60 vars in 1164 bytes} [Thu Aug 4 22:28:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:28:59.932161 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-831750958", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28ae2b17-c5f1-41ff-82ff-0d99f599604c"}], "security_groups": [{"name": "tempest-securitygroup--764952561"}], "key_name": "tempest-keypair-1786916654", "user_data": "}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:28:59.944044 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:29:00.043395 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.network.neutron [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] validate_networks() for [('28ae2b17-c5f1-41ff-82ff-0d99f599604c', None, None, None, None, None)] {{(pid=129196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:29:00.412182 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Flavor limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:29:00.412612 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Image limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:29:00.413086 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Flavor pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:29:00.413526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Image pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:29:00.414122 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:29:00.423755 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:00.424240 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:00.424686 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:00.425433 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:00.425905 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:00.426337 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:00.443588 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Getting quotas for project 477c661a08dd46b2a20f53a7944361ef. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:29:00.447555 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Getting quotas for user 890f3e80ae37401f8dad15d3d084f091 and project 477c661a08dd46b2a20f53a7944361ef. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:29:00.459663 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Going to run 1 instances... {{(pid=129196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:29:00.461943 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:29:00.511854 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-08a6d064-abac-4eea-b3ea-0fdcceb074ff tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.583874 Aug 04 22:29:00.512753 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 453/902] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:28:59 2022] POST /compute/v2.1/servers => generated 403 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:29:00.520344 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:29:00.524440 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3c791d82-167a-4803-956f-872fbcce0529 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:00.525178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3c791d82-167a-4803-956f-872fbcce0529 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:00.589907 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3c791d82-167a-4803-956f-872fbcce0529 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:00.597457 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3c791d82-167a-4803-956f-872fbcce0529 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1241 microversion: 2.1 time: 0.077765 Aug 04 22:29:00.598021 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 450/903] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:29:00 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:29:01.619449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-73299ac9-5f69-4a96-9291-814d23831806 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:01.620883 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-73299ac9-5f69-4a96-9291-814d23831806 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:01.632000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73299ac9-5f69-4a96-9291-814d23831806 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:01.632536 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73299ac9-5f69-4a96-9291-814d23831806 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:01.633028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73299ac9-5f69-4a96-9291-814d23831806 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:01.633766 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73299ac9-5f69-4a96-9291-814d23831806 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:01.634320 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73299ac9-5f69-4a96-9291-814d23831806 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:01.634815 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73299ac9-5f69-4a96-9291-814d23831806 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:01.986713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-73299ac9-5f69-4a96-9291-814d23831806 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:01.994296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-73299ac9-5f69-4a96-9291-814d23831806 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1301 microversion: 2.1 time: 0.379333 Aug 04 22:29:01.995076 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 454/904] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:29:01 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1301 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:29:03.016231 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-81280e80-c852-4a76-befd-0b3711a2a792 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:03.017373 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-81280e80-c852-4a76-befd-0b3711a2a792 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:03.023674 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81280e80-c852-4a76-befd-0b3711a2a792 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:03.024378 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81280e80-c852-4a76-befd-0b3711a2a792 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:03.024976 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81280e80-c852-4a76-befd-0b3711a2a792 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:03.025889 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81280e80-c852-4a76-befd-0b3711a2a792 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:03.026514 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81280e80-c852-4a76-befd-0b3711a2a792 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:03.027117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81280e80-c852-4a76-befd-0b3711a2a792 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:03.186125 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-81280e80-c852-4a76-befd-0b3711a2a792 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:03.193659 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-81280e80-c852-4a76-befd-0b3711a2a792 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1366 microversion: 2.1 time: 0.181736 Aug 04 22:29:03.194242 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 451/905] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:29:03 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:29:03.289872 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-24353d7a-d3eb-4869-86bd-1b11f75f9b8b req-7568f8ce-2fee-4ae1-a1df-470583fa7016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2baedf2f-2718-4cb2-a417-a230761f4002", "tag": "6069b7b2-b1e6-49a7-a9a8-3edcfd6c9a60"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:29:03.301390 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-24353d7a-d3eb-4869-86bd-1b11f75f9b8b req-7568f8ce-2fee-4ae1-a1df-470583fa7016 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:03.301892 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-24353d7a-d3eb-4869-86bd-1b11f75f9b8b req-7568f8ce-2fee-4ae1-a1df-470583fa7016 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:03.302532 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-24353d7a-d3eb-4869-86bd-1b11f75f9b8b req-7568f8ce-2fee-4ae1-a1df-470583fa7016 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:03.315068 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-24353d7a-d3eb-4869-86bd-1b11f75f9b8b req-7568f8ce-2fee-4ae1-a1df-470583fa7016 service nova] Creating event network-changed:6069b7b2-b1e6-49a7-a9a8-3edcfd6c9a60 for instance 2baedf2f-2718-4cb2-a417-a230761f4002 on hv-cinder-85221 Aug 04 22:29:03.319844 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-24353d7a-d3eb-4869-86bd-1b11f75f9b8b req-7568f8ce-2fee-4ae1-a1df-470583fa7016 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034070 Aug 04 22:29:03.320585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 455/906] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:29:04.215093 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-dc5242d3-f95b-4de2-8031-19d29c971adf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:04.215703 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-dc5242d3-f95b-4de2-8031-19d29c971adf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:04.221653 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dc5242d3-f95b-4de2-8031-19d29c971adf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:04.222130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dc5242d3-f95b-4de2-8031-19d29c971adf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:04.222558 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dc5242d3-f95b-4de2-8031-19d29c971adf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:04.223237 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dc5242d3-f95b-4de2-8031-19d29c971adf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:04.223683 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dc5242d3-f95b-4de2-8031-19d29c971adf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:04.224127 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dc5242d3-f95b-4de2-8031-19d29c971adf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:04.354179 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-dc5242d3-f95b-4de2-8031-19d29c971adf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:04.361806 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-dc5242d3-f95b-4de2-8031-19d29c971adf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1366 microversion: 2.1 time: 0.150584 Aug 04 22:29:04.362449 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 452/907] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:29:04 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:29:05.383343 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8719f940-44e6-4995-870d-2c4f7ae03e7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:05.384040 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8719f940-44e6-4995-870d-2c4f7ae03e7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:05.391952 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8719f940-44e6-4995-870d-2c4f7ae03e7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:05.392368 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8719f940-44e6-4995-870d-2c4f7ae03e7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:05.392805 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8719f940-44e6-4995-870d-2c4f7ae03e7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:05.393519 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8719f940-44e6-4995-870d-2c4f7ae03e7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:05.393979 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8719f940-44e6-4995-870d-2c4f7ae03e7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:05.394406 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8719f940-44e6-4995-870d-2c4f7ae03e7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:05.528107 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8719f940-44e6-4995-870d-2c4f7ae03e7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:05.535628 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8719f940-44e6-4995-870d-2c4f7ae03e7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1366 microversion: 2.1 time: 0.156923 Aug 04 22:29:05.536193 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 456/908] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:29:05 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:29:06.556203 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-81d64b07-eefd-4bca-bc03-0a5ccd9b107c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:06.556921 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-81d64b07-eefd-4bca-bc03-0a5ccd9b107c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:06.562771 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81d64b07-eefd-4bca-bc03-0a5ccd9b107c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:06.563376 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81d64b07-eefd-4bca-bc03-0a5ccd9b107c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:06.563860 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81d64b07-eefd-4bca-bc03-0a5ccd9b107c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:06.564926 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81d64b07-eefd-4bca-bc03-0a5ccd9b107c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:06.565780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81d64b07-eefd-4bca-bc03-0a5ccd9b107c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:06.566337 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-81d64b07-eefd-4bca-bc03-0a5ccd9b107c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:06.705899 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-81d64b07-eefd-4bca-bc03-0a5ccd9b107c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:06.713968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-81d64b07-eefd-4bca-bc03-0a5ccd9b107c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1366 microversion: 2.1 time: 0.160892 Aug 04 22:29:06.714543 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 453/909] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:29:06 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:29:07.734800 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5bc45d8a-137d-4ae5-a2aa-f3f8b5a63962 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:07.735414 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5bc45d8a-137d-4ae5-a2aa-f3f8b5a63962 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:07.741931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5bc45d8a-137d-4ae5-a2aa-f3f8b5a63962 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:07.742423 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5bc45d8a-137d-4ae5-a2aa-f3f8b5a63962 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:07.742861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5bc45d8a-137d-4ae5-a2aa-f3f8b5a63962 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:07.743727 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5bc45d8a-137d-4ae5-a2aa-f3f8b5a63962 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:07.744731 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5bc45d8a-137d-4ae5-a2aa-f3f8b5a63962 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:07.745170 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5bc45d8a-137d-4ae5-a2aa-f3f8b5a63962 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:07.873881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5bc45d8a-137d-4ae5-a2aa-f3f8b5a63962 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:07.881300 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5bc45d8a-137d-4ae5-a2aa-f3f8b5a63962 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1366 microversion: 2.1 time: 0.150347 Aug 04 22:29:07.881884 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 457/910] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:29:07 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:29:08.904289 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c69fb772-9a8a-487f-8f32-d1ea5d6d4b06 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:08.904899 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c69fb772-9a8a-487f-8f32-d1ea5d6d4b06 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:08.910824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c69fb772-9a8a-487f-8f32-d1ea5d6d4b06 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:08.911311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c69fb772-9a8a-487f-8f32-d1ea5d6d4b06 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:08.911745 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c69fb772-9a8a-487f-8f32-d1ea5d6d4b06 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:08.912442 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c69fb772-9a8a-487f-8f32-d1ea5d6d4b06 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:08.912880 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c69fb772-9a8a-487f-8f32-d1ea5d6d4b06 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:08.913326 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c69fb772-9a8a-487f-8f32-d1ea5d6d4b06 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:09.042275 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c69fb772-9a8a-487f-8f32-d1ea5d6d4b06 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:09.049694 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c69fb772-9a8a-487f-8f32-d1ea5d6d4b06 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1366 microversion: 2.1 time: 0.149813 Aug 04 22:29:09.050256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 454/911] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:29:08 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:29:10.070944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f93861f6-bade-40b7-ae49-dacc00ff084c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:10.071489 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f93861f6-bade-40b7-ae49-dacc00ff084c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:10.078548 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f93861f6-bade-40b7-ae49-dacc00ff084c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:10.079031 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f93861f6-bade-40b7-ae49-dacc00ff084c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:10.079467 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f93861f6-bade-40b7-ae49-dacc00ff084c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:10.080155 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f93861f6-bade-40b7-ae49-dacc00ff084c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:10.080611 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f93861f6-bade-40b7-ae49-dacc00ff084c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:10.081032 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f93861f6-bade-40b7-ae49-dacc00ff084c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:10.209996 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f93861f6-bade-40b7-ae49-dacc00ff084c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:10.217595 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f93861f6-bade-40b7-ae49-dacc00ff084c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1366 microversion: 2.1 time: 0.150515 Aug 04 22:29:10.218161 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 458/912] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:29:10 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:29:10.354595 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-4675653e-18f0-42a2-8b26-2744b0445034 req-27e49b1c-817f-4568-bfaa-380562d27614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2baedf2f-2718-4cb2-a417-a230761f4002", "name": "network-vif-plugged", "status": "completed", "tag": "6069b7b2-b1e6-49a7-a9a8-3edcfd6c9a60"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:29:10.364964 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-4675653e-18f0-42a2-8b26-2744b0445034 req-27e49b1c-817f-4568-bfaa-380562d27614 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:10.365674 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-4675653e-18f0-42a2-8b26-2744b0445034 req-27e49b1c-817f-4568-bfaa-380562d27614 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:10.366247 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-4675653e-18f0-42a2-8b26-2744b0445034 req-27e49b1c-817f-4568-bfaa-380562d27614 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:10.378395 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-4675653e-18f0-42a2-8b26-2744b0445034 req-27e49b1c-817f-4568-bfaa-380562d27614 service nova] Creating event network-vif-plugged:6069b7b2-b1e6-49a7-a9a8-3edcfd6c9a60 for instance 2baedf2f-2718-4cb2-a417-a230761f4002 on hv-cinder-85221 Aug 04 22:29:10.383373 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-4675653e-18f0-42a2-8b26-2744b0445034 req-27e49b1c-817f-4568-bfaa-380562d27614 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033613 Aug 04 22:29:10.384013 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 455/913] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:29:11.239103 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-91d13ed4-862b-4d53-8541-f8ff9b43fbe3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:11.239643 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-91d13ed4-862b-4d53-8541-f8ff9b43fbe3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:11.241658 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:29:11.242314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=6 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:29:11.249696 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-91d13ed4-862b-4d53-8541-f8ff9b43fbe3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:11.250178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-91d13ed4-862b-4d53-8541-f8ff9b43fbe3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:11.250612 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-91d13ed4-862b-4d53-8541-f8ff9b43fbe3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:11.251333 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-91d13ed4-862b-4d53-8541-f8ff9b43fbe3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:11.251792 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-91d13ed4-862b-4d53-8541-f8ff9b43fbe3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:11.252217 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-91d13ed4-862b-4d53-8541-f8ff9b43fbe3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:11.381321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-91d13ed4-862b-4d53-8541-f8ff9b43fbe3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:11.389088 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-91d13ed4-862b-4d53-8541-f8ff9b43fbe3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1366 microversion: 2.1 time: 0.153888 Aug 04 22:29:11.389693 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 459/914] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:29:11 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:29:12.407414 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=6 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:29:12.411648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-69dc5f23-ed3a-4d10-a896-020b6f11f668 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:12.412338 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-69dc5f23-ed3a-4d10-a896-020b6f11f668 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:12.419430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-69dc5f23-ed3a-4d10-a896-020b6f11f668 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:12.419910 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-69dc5f23-ed3a-4d10-a896-020b6f11f668 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:12.420343 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-69dc5f23-ed3a-4d10-a896-020b6f11f668 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:12.421026 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-69dc5f23-ed3a-4d10-a896-020b6f11f668 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:12.421498 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-69dc5f23-ed3a-4d10-a896-020b6f11f668 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:12.421920 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-69dc5f23-ed3a-4d10-a896-020b6f11f668 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:12.558994 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-69dc5f23-ed3a-4d10-a896-020b6f11f668 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:12.566579 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-69dc5f23-ed3a-4d10-a896-020b6f11f668 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1366 microversion: 2.1 time: 0.160176 Aug 04 22:29:12.567144 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 456/915] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:29:12 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:29:13.588213 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9c34ae70-8bc5-481c-b082-0d6b69608363 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:13.588823 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9c34ae70-8bc5-481c-b082-0d6b69608363 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:13.595402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9c34ae70-8bc5-481c-b082-0d6b69608363 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:13.595886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9c34ae70-8bc5-481c-b082-0d6b69608363 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:13.596321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9c34ae70-8bc5-481c-b082-0d6b69608363 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:13.597015 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9c34ae70-8bc5-481c-b082-0d6b69608363 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:13.597509 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9c34ae70-8bc5-481c-b082-0d6b69608363 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:13.597941 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9c34ae70-8bc5-481c-b082-0d6b69608363 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:13.730415 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9c34ae70-8bc5-481c-b082-0d6b69608363 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:13.737770 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9c34ae70-8bc5-481c-b082-0d6b69608363 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1552 microversion: 2.1 time: 0.153445 Aug 04 22:29:13.738337 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 460/916] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:29:13 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:29:13.758012 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f9139579-f4b6-4dea-8633-ec7dffdf64aa tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:13.758563 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f9139579-f4b6-4dea-8633-ec7dffdf64aa tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:13.765165 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9139579-f4b6-4dea-8633-ec7dffdf64aa tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:13.765707 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9139579-f4b6-4dea-8633-ec7dffdf64aa tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:13.766142 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9139579-f4b6-4dea-8633-ec7dffdf64aa tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:13.766839 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9139579-f4b6-4dea-8633-ec7dffdf64aa tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:13.767286 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9139579-f4b6-4dea-8633-ec7dffdf64aa tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:13.767701 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f9139579-f4b6-4dea-8633-ec7dffdf64aa tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:13.847296 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f9139579-f4b6-4dea-8633-ec7dffdf64aa tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093089 Aug 04 22:29:13.847897 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 457/917] 10.222.0.109 () {58 vars in 1280 bytes} [Thu Aug 4 22:29:13 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:29:15.018239 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-a5b5f4f7-4dd5-49bf-9565-e9b0d28f9674 req-a1fa99ab-6aae-46f4-80e4-2da534be7b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2baedf2f-2718-4cb2-a417-a230761f4002", "tag": "6069b7b2-b1e6-49a7-a9a8-3edcfd6c9a60"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:29:15.028941 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a5b5f4f7-4dd5-49bf-9565-e9b0d28f9674 req-a1fa99ab-6aae-46f4-80e4-2da534be7b12 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:15.029522 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a5b5f4f7-4dd5-49bf-9565-e9b0d28f9674 req-a1fa99ab-6aae-46f4-80e4-2da534be7b12 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:15.029957 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a5b5f4f7-4dd5-49bf-9565-e9b0d28f9674 req-a1fa99ab-6aae-46f4-80e4-2da534be7b12 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:15.040567 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-a5b5f4f7-4dd5-49bf-9565-e9b0d28f9674 req-a1fa99ab-6aae-46f4-80e4-2da534be7b12 service nova] Creating event network-changed:6069b7b2-b1e6-49a7-a9a8-3edcfd6c9a60 for instance 2baedf2f-2718-4cb2-a417-a230761f4002 on hv-cinder-85221 Aug 04 22:29:15.045769 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-a5b5f4f7-4dd5-49bf-9565-e9b0d28f9674 req-a1fa99ab-6aae-46f4-80e4-2da534be7b12 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031168 Aug 04 22:29:15.046371 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 461/918] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:29:39.168753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:29:39.169631 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=36 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:29:39.173813 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-76b27e68-ef71-4b33-bc5a-cfbd26618ec0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:39.174331 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-76b27e68-ef71-4b33-bc5a-cfbd26618ec0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:39.181590 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-76b27e68-ef71-4b33-bc5a-cfbd26618ec0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:39.182079 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-76b27e68-ef71-4b33-bc5a-cfbd26618ec0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:39.182516 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-76b27e68-ef71-4b33-bc5a-cfbd26618ec0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:39.183208 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-76b27e68-ef71-4b33-bc5a-cfbd26618ec0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:39.183665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-76b27e68-ef71-4b33-bc5a-cfbd26618ec0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:39.184090 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-76b27e68-ef71-4b33-bc5a-cfbd26618ec0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:39.206845 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-76b27e68-ef71-4b33-bc5a-cfbd26618ec0 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/ips" status: 200 len: 153 microversion: 2.20 time: 0.039015 Aug 04 22:29:39.207410 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 458/919] 10.222.0.109 () {60 vars in 1294 bytes} [Thu Aug 4 22:29:39 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:29:41.609919 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:29:41.610655 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=42 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:29:41.614853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-63a73cea-d51e-4d61-948c-0e3179c79ab4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:29:41.615476 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-63a73cea-d51e-4d61-948c-0e3179c79ab4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:41.623350 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-63a73cea-d51e-4d61-948c-0e3179c79ab4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:41.623841 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-63a73cea-d51e-4d61-948c-0e3179c79ab4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:41.624281 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-63a73cea-d51e-4d61-948c-0e3179c79ab4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:41.624979 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-63a73cea-d51e-4d61-948c-0e3179c79ab4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:41.625464 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-63a73cea-d51e-4d61-948c-0e3179c79ab4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:41.625897 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-63a73cea-d51e-4d61-948c-0e3179c79ab4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:41.649584 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-63a73cea-d51e-4d61-948c-0e3179c79ab4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lazy-loading 'flavor' on Instance uuid 51e61c4e-2c74-44c2-90bd-f997db2fbd0a {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:29:41.821362 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-63a73cea-d51e-4d61-948c-0e3179c79ab4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "POST /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/action" status: 202 len: 0 microversion: 2.20 time: 0.212876 Aug 04 22:29:41.821969 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 462/920] 10.222.0.109 () {62 vars in 1324 bytes} [Thu Aug 4 22:29:41 2022] POST /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:29:41.836217 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0cb5f6d7-3f3f-416a-92bd-4b20a55d6cbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:41.836831 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0cb5f6d7-3f3f-416a-92bd-4b20a55d6cbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:41.843405 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0cb5f6d7-3f3f-416a-92bd-4b20a55d6cbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:41.843902 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0cb5f6d7-3f3f-416a-92bd-4b20a55d6cbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:41.844342 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0cb5f6d7-3f3f-416a-92bd-4b20a55d6cbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:41.845040 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0cb5f6d7-3f3f-416a-92bd-4b20a55d6cbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:41.845520 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0cb5f6d7-3f3f-416a-92bd-4b20a55d6cbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:41.845944 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0cb5f6d7-3f3f-416a-92bd-4b20a55d6cbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:41.982561 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0cb5f6d7-3f3f-416a-92bd-4b20a55d6cbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:41.990374 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0cb5f6d7-3f3f-416a-92bd-4b20a55d6cbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:41.992521 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0cb5f6d7-3f3f-416a-92bd-4b20a55d6cbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:41.993865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0cb5f6d7-3f3f-416a-92bd-4b20a55d6cbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.162045 Aug 04 22:29:41.994468 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 459/921] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:41 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:29:43.017223 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d9c1be5b-e6e5-4779-b296-5efa30ad5911 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:43.017961 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d9c1be5b-e6e5-4779-b296-5efa30ad5911 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:43.025009 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d9c1be5b-e6e5-4779-b296-5efa30ad5911 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:43.025517 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d9c1be5b-e6e5-4779-b296-5efa30ad5911 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:43.025946 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d9c1be5b-e6e5-4779-b296-5efa30ad5911 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:43.026627 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d9c1be5b-e6e5-4779-b296-5efa30ad5911 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:43.027069 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d9c1be5b-e6e5-4779-b296-5efa30ad5911 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:43.027490 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d9c1be5b-e6e5-4779-b296-5efa30ad5911 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:43.156119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d9c1be5b-e6e5-4779-b296-5efa30ad5911 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:43.164483 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d9c1be5b-e6e5-4779-b296-5efa30ad5911 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:43.166274 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-d9c1be5b-e6e5-4779-b296-5efa30ad5911 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:43.167433 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d9c1be5b-e6e5-4779-b296-5efa30ad5911 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.154917 Aug 04 22:29:43.167995 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 463/922] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:43 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:29:44.190297 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-48eeb549-ecef-4842-9d6d-09ccd95d2549 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:44.190912 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-48eeb549-ecef-4842-9d6d-09ccd95d2549 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:44.197083 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-48eeb549-ecef-4842-9d6d-09ccd95d2549 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:44.197612 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-48eeb549-ecef-4842-9d6d-09ccd95d2549 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:44.198049 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-48eeb549-ecef-4842-9d6d-09ccd95d2549 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:44.198738 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-48eeb549-ecef-4842-9d6d-09ccd95d2549 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:44.199189 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-48eeb549-ecef-4842-9d6d-09ccd95d2549 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:44.199611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-48eeb549-ecef-4842-9d6d-09ccd95d2549 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:44.338157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-48eeb549-ecef-4842-9d6d-09ccd95d2549 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:44.346027 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-48eeb549-ecef-4842-9d6d-09ccd95d2549 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:44.347529 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-48eeb549-ecef-4842-9d6d-09ccd95d2549 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:44.348677 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-48eeb549-ecef-4842-9d6d-09ccd95d2549 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.162265 Aug 04 22:29:44.349234 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 460/923] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:44 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:29:45.372817 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6314bb8d-77db-41ec-a0d0-b55c9df013ef tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:45.373455 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6314bb8d-77db-41ec-a0d0-b55c9df013ef tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:45.379913 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6314bb8d-77db-41ec-a0d0-b55c9df013ef tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:45.380399 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6314bb8d-77db-41ec-a0d0-b55c9df013ef tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:45.380840 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6314bb8d-77db-41ec-a0d0-b55c9df013ef tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:45.381570 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6314bb8d-77db-41ec-a0d0-b55c9df013ef tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:45.382683 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6314bb8d-77db-41ec-a0d0-b55c9df013ef tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:45.383110 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6314bb8d-77db-41ec-a0d0-b55c9df013ef tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:45.511109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6314bb8d-77db-41ec-a0d0-b55c9df013ef tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:45.518995 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6314bb8d-77db-41ec-a0d0-b55c9df013ef tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:45.520518 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6314bb8d-77db-41ec-a0d0-b55c9df013ef tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:45.521699 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6314bb8d-77db-41ec-a0d0-b55c9df013ef tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.152799 Aug 04 22:29:45.522248 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 464/924] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:45 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:29:46.544210 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f283f0ac-58ba-4cad-bdcf-ff3f0eb64b53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:46.544830 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f283f0ac-58ba-4cad-bdcf-ff3f0eb64b53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:46.550808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f283f0ac-58ba-4cad-bdcf-ff3f0eb64b53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:46.551296 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f283f0ac-58ba-4cad-bdcf-ff3f0eb64b53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:46.551799 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f283f0ac-58ba-4cad-bdcf-ff3f0eb64b53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:46.552492 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f283f0ac-58ba-4cad-bdcf-ff3f0eb64b53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:46.552950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f283f0ac-58ba-4cad-bdcf-ff3f0eb64b53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:46.553377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f283f0ac-58ba-4cad-bdcf-ff3f0eb64b53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:46.685555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f283f0ac-58ba-4cad-bdcf-ff3f0eb64b53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:46.693352 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f283f0ac-58ba-4cad-bdcf-ff3f0eb64b53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:46.695507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f283f0ac-58ba-4cad-bdcf-ff3f0eb64b53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:46.696667 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f283f0ac-58ba-4cad-bdcf-ff3f0eb64b53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.156337 Aug 04 22:29:46.697231 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 461/925] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:46 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:29:47.719461 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-40c7f698-71c8-4a8a-90c1-df63f6257e68 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:47.720078 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-40c7f698-71c8-4a8a-90c1-df63f6257e68 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:47.727541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-40c7f698-71c8-4a8a-90c1-df63f6257e68 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:47.728029 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-40c7f698-71c8-4a8a-90c1-df63f6257e68 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:47.728468 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-40c7f698-71c8-4a8a-90c1-df63f6257e68 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:47.729195 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-40c7f698-71c8-4a8a-90c1-df63f6257e68 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:47.729679 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-40c7f698-71c8-4a8a-90c1-df63f6257e68 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:47.730110 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-40c7f698-71c8-4a8a-90c1-df63f6257e68 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:47.862247 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-40c7f698-71c8-4a8a-90c1-df63f6257e68 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:47.870863 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-40c7f698-71c8-4a8a-90c1-df63f6257e68 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:47.872355 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-40c7f698-71c8-4a8a-90c1-df63f6257e68 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:47.873530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-40c7f698-71c8-4a8a-90c1-df63f6257e68 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.157946 Aug 04 22:29:47.874096 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 465/926] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:47 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:29:48.896172 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-421f9ce1-b922-4ff8-a1bc-1250fa2cab8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:48.896818 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-421f9ce1-b922-4ff8-a1bc-1250fa2cab8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:48.902933 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-421f9ce1-b922-4ff8-a1bc-1250fa2cab8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:48.903418 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-421f9ce1-b922-4ff8-a1bc-1250fa2cab8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:48.903854 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-421f9ce1-b922-4ff8-a1bc-1250fa2cab8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:48.904545 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-421f9ce1-b922-4ff8-a1bc-1250fa2cab8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:48.905002 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-421f9ce1-b922-4ff8-a1bc-1250fa2cab8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:48.905447 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-421f9ce1-b922-4ff8-a1bc-1250fa2cab8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:49.032093 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-421f9ce1-b922-4ff8-a1bc-1250fa2cab8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:49.040613 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-421f9ce1-b922-4ff8-a1bc-1250fa2cab8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:49.042233 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-421f9ce1-b922-4ff8-a1bc-1250fa2cab8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:49.043394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-421f9ce1-b922-4ff8-a1bc-1250fa2cab8f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.151113 Aug 04 22:29:49.043954 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 462/927] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:48 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:29:50.066730 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-087ef4b6-5a22-438d-b7d4-7dfe64fb9d3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:50.067418 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-087ef4b6-5a22-438d-b7d4-7dfe64fb9d3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:50.078023 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-087ef4b6-5a22-438d-b7d4-7dfe64fb9d3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:50.078509 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-087ef4b6-5a22-438d-b7d4-7dfe64fb9d3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:50.078938 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-087ef4b6-5a22-438d-b7d4-7dfe64fb9d3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:50.079667 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-087ef4b6-5a22-438d-b7d4-7dfe64fb9d3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:50.080114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-087ef4b6-5a22-438d-b7d4-7dfe64fb9d3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:50.080535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-087ef4b6-5a22-438d-b7d4-7dfe64fb9d3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:50.208391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-087ef4b6-5a22-438d-b7d4-7dfe64fb9d3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:50.217372 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-087ef4b6-5a22-438d-b7d4-7dfe64fb9d3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:50.218896 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-087ef4b6-5a22-438d-b7d4-7dfe64fb9d3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:50.220038 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-087ef4b6-5a22-438d-b7d4-7dfe64fb9d3e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.157455 Aug 04 22:29:50.220580 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 466/928] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:50 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:29:51.244130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-88716d86-0e18-4aab-aa0f-7bf690a76b55 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:51.244683 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-88716d86-0e18-4aab-aa0f-7bf690a76b55 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:51.250702 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88716d86-0e18-4aab-aa0f-7bf690a76b55 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:51.251189 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88716d86-0e18-4aab-aa0f-7bf690a76b55 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:51.251623 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88716d86-0e18-4aab-aa0f-7bf690a76b55 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:51.252328 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88716d86-0e18-4aab-aa0f-7bf690a76b55 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:51.252783 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88716d86-0e18-4aab-aa0f-7bf690a76b55 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:51.253208 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88716d86-0e18-4aab-aa0f-7bf690a76b55 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:51.384555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-88716d86-0e18-4aab-aa0f-7bf690a76b55 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:51.392340 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-88716d86-0e18-4aab-aa0f-7bf690a76b55 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:51.393868 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-88716d86-0e18-4aab-aa0f-7bf690a76b55 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:51.395011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-88716d86-0e18-4aab-aa0f-7bf690a76b55 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.155742 Aug 04 22:29:51.395579 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 463/929] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:51 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:29:52.417847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c55c737d-ec70-4ec4-bac8-7bcc20904e3a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:52.418433 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c55c737d-ec70-4ec4-bac8-7bcc20904e3a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:52.424893 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c55c737d-ec70-4ec4-bac8-7bcc20904e3a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:52.425377 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c55c737d-ec70-4ec4-bac8-7bcc20904e3a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:52.425847 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c55c737d-ec70-4ec4-bac8-7bcc20904e3a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:52.426543 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c55c737d-ec70-4ec4-bac8-7bcc20904e3a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:52.427029 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c55c737d-ec70-4ec4-bac8-7bcc20904e3a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:52.427457 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c55c737d-ec70-4ec4-bac8-7bcc20904e3a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:52.561791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c55c737d-ec70-4ec4-bac8-7bcc20904e3a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:52.570446 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c55c737d-ec70-4ec4-bac8-7bcc20904e3a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:52.571931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c55c737d-ec70-4ec4-bac8-7bcc20904e3a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:52.573069 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c55c737d-ec70-4ec4-bac8-7bcc20904e3a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.159385 Aug 04 22:29:52.573650 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 467/930] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:52 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:29:53.596538 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2fd12906-ffe0-466f-bf31-5e2e2dbd7117 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:53.597134 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2fd12906-ffe0-466f-bf31-5e2e2dbd7117 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:53.603507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2fd12906-ffe0-466f-bf31-5e2e2dbd7117 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:53.603993 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2fd12906-ffe0-466f-bf31-5e2e2dbd7117 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:53.604429 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2fd12906-ffe0-466f-bf31-5e2e2dbd7117 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:53.605130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2fd12906-ffe0-466f-bf31-5e2e2dbd7117 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:53.605623 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2fd12906-ffe0-466f-bf31-5e2e2dbd7117 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:53.606085 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2fd12906-ffe0-466f-bf31-5e2e2dbd7117 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:53.735454 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2fd12906-ffe0-466f-bf31-5e2e2dbd7117 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:53.744579 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2fd12906-ffe0-466f-bf31-5e2e2dbd7117 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:53.746121 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2fd12906-ffe0-466f-bf31-5e2e2dbd7117 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:53.747281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2fd12906-ffe0-466f-bf31-5e2e2dbd7117 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.154628 Aug 04 22:29:53.747842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 464/931] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:53 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:29:54.770120 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f3bcd348-f121-4618-92ea-686a0286b9d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:54.770761 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f3bcd348-f121-4618-92ea-686a0286b9d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:54.777812 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f3bcd348-f121-4618-92ea-686a0286b9d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:54.778297 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f3bcd348-f121-4618-92ea-686a0286b9d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:54.778732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f3bcd348-f121-4618-92ea-686a0286b9d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:54.779426 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f3bcd348-f121-4618-92ea-686a0286b9d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:54.779886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f3bcd348-f121-4618-92ea-686a0286b9d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:54.780314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f3bcd348-f121-4618-92ea-686a0286b9d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:54.907213 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f3bcd348-f121-4618-92ea-686a0286b9d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:54.915108 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f3bcd348-f121-4618-92ea-686a0286b9d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:54.916604 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f3bcd348-f121-4618-92ea-686a0286b9d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:54.917788 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f3bcd348-f121-4618-92ea-686a0286b9d9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.151519 Aug 04 22:29:54.918345 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 468/932] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:54 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:29:55.940546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-60020af4-f470-417b-9230-cfcee337c3dd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:55.941231 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-60020af4-f470-417b-9230-cfcee337c3dd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:55.947818 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60020af4-f470-417b-9230-cfcee337c3dd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:55.948299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60020af4-f470-417b-9230-cfcee337c3dd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:55.948725 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60020af4-f470-417b-9230-cfcee337c3dd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:55.949427 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60020af4-f470-417b-9230-cfcee337c3dd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:55.949875 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60020af4-f470-417b-9230-cfcee337c3dd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:55.950291 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-60020af4-f470-417b-9230-cfcee337c3dd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:56.080486 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-60020af4-f470-417b-9230-cfcee337c3dd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:56.088430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-60020af4-f470-417b-9230-cfcee337c3dd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:56.089958 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-60020af4-f470-417b-9230-cfcee337c3dd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:56.091094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-60020af4-f470-417b-9230-cfcee337c3dd tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.154601 Aug 04 22:29:56.091647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 465/933] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:55 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:29:57.113545 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-93623036-2ebb-4d81-a645-e3638480d551 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:57.114157 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-93623036-2ebb-4d81-a645-e3638480d551 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:57.122104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-93623036-2ebb-4d81-a645-e3638480d551 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:57.122578 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-93623036-2ebb-4d81-a645-e3638480d551 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:57.123005 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-93623036-2ebb-4d81-a645-e3638480d551 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:57.123686 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-93623036-2ebb-4d81-a645-e3638480d551 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:57.124163 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-93623036-2ebb-4d81-a645-e3638480d551 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:57.124585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-93623036-2ebb-4d81-a645-e3638480d551 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:57.262118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-93623036-2ebb-4d81-a645-e3638480d551 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:57.269917 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-93623036-2ebb-4d81-a645-e3638480d551 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:57.271413 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-93623036-2ebb-4d81-a645-e3638480d551 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:57.273204 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-93623036-2ebb-4d81-a645-e3638480d551 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.163666 Aug 04 22:29:57.273802 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 469/934] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:57 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:29:58.295752 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4da4edb3-c248-4211-8c47-99a317754ee4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:58.296364 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4da4edb3-c248-4211-8c47-99a317754ee4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:58.302394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4da4edb3-c248-4211-8c47-99a317754ee4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:58.303008 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4da4edb3-c248-4211-8c47-99a317754ee4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:58.303466 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4da4edb3-c248-4211-8c47-99a317754ee4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:58.304145 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4da4edb3-c248-4211-8c47-99a317754ee4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:58.304601 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4da4edb3-c248-4211-8c47-99a317754ee4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:58.305029 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4da4edb3-c248-4211-8c47-99a317754ee4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:58.433646 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4da4edb3-c248-4211-8c47-99a317754ee4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:58.441565 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4da4edb3-c248-4211-8c47-99a317754ee4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:58.443105 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4da4edb3-c248-4211-8c47-99a317754ee4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:58.444944 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4da4edb3-c248-4211-8c47-99a317754ee4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.153148 Aug 04 22:29:58.445524 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 466/935] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:58 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:29:59.468172 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b52045f9-c3d6-4ee3-86a4-1a690328a729 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:29:59.468781 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b52045f9-c3d6-4ee3-86a4-1a690328a729 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:29:59.476052 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b52045f9-c3d6-4ee3-86a4-1a690328a729 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:59.476533 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b52045f9-c3d6-4ee3-86a4-1a690328a729 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:59.476967 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b52045f9-c3d6-4ee3-86a4-1a690328a729 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:59.477688 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b52045f9-c3d6-4ee3-86a4-1a690328a729 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:29:59.478177 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b52045f9-c3d6-4ee3-86a4-1a690328a729 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:29:59.478607 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b52045f9-c3d6-4ee3-86a4-1a690328a729 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:29:59.605954 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b52045f9-c3d6-4ee3-86a4-1a690328a729 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:59.613803 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b52045f9-c3d6-4ee3-86a4-1a690328a729 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:59.615347 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b52045f9-c3d6-4ee3-86a4-1a690328a729 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:29:59.616494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b52045f9-c3d6-4ee3-86a4-1a690328a729 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1751 microversion: 2.20 time: 0.152257 Aug 04 22:29:59.617053 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 470/936] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:29:59 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:00.639525 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d4b7181a-7772-48c9-966e-11cb0696558b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:00.640142 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d4b7181a-7772-48c9-966e-11cb0696558b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:00.646066 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4b7181a-7772-48c9-966e-11cb0696558b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:00.646713 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4b7181a-7772-48c9-966e-11cb0696558b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:00.646713 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4b7181a-7772-48c9-966e-11cb0696558b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:00.647710 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4b7181a-7772-48c9-966e-11cb0696558b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:00.648158 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4b7181a-7772-48c9-966e-11cb0696558b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:00.648577 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d4b7181a-7772-48c9-966e-11cb0696558b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:00.780221 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d4b7181a-7772-48c9-966e-11cb0696558b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:00.788593 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d4b7181a-7772-48c9-966e-11cb0696558b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:00.790110 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d4b7181a-7772-48c9-966e-11cb0696558b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:00.791255 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d4b7181a-7772-48c9-966e-11cb0696558b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1751 microversion: 2.20 time: 0.155594 Aug 04 22:30:00.791808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 467/937] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:00 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:01.816010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-42d71553-d04f-4f66-84dc-b465d5d13b02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:01.816539 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-42d71553-d04f-4f66-84dc-b465d5d13b02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:01.823484 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-42d71553-d04f-4f66-84dc-b465d5d13b02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:01.823966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-42d71553-d04f-4f66-84dc-b465d5d13b02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:01.824400 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-42d71553-d04f-4f66-84dc-b465d5d13b02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:01.825091 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-42d71553-d04f-4f66-84dc-b465d5d13b02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:01.825572 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-42d71553-d04f-4f66-84dc-b465d5d13b02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:01.825998 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-42d71553-d04f-4f66-84dc-b465d5d13b02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:01.956707 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-42d71553-d04f-4f66-84dc-b465d5d13b02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:01.965283 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-42d71553-d04f-4f66-84dc-b465d5d13b02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:01.966820 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-42d71553-d04f-4f66-84dc-b465d5d13b02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:01.967974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-42d71553-d04f-4f66-84dc-b465d5d13b02 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1751 microversion: 2.20 time: 0.156127 Aug 04 22:30:01.968534 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 471/938] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:01 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:02.678063 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-fdb4a9f1-2dea-4915-9520-8c12a0fdc072 req-2997a150-a5f6-4707-be3f-2778120b6221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e61c4e-2c74-44c2-90bd-f997db2fbd0a", "name": "network-vif-plugged", "status": "completed", "tag": "9bb4a82b-caa1-4ea9-a34f-05e170ce6471"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:02.688147 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-fdb4a9f1-2dea-4915-9520-8c12a0fdc072 req-2997a150-a5f6-4707-be3f-2778120b6221 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:02.688629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-fdb4a9f1-2dea-4915-9520-8c12a0fdc072 req-2997a150-a5f6-4707-be3f-2778120b6221 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:02.689058 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-fdb4a9f1-2dea-4915-9520-8c12a0fdc072 req-2997a150-a5f6-4707-be3f-2778120b6221 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:02.700699 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-fdb4a9f1-2dea-4915-9520-8c12a0fdc072 req-2997a150-a5f6-4707-be3f-2778120b6221 service nova] Creating event network-vif-plugged:9bb4a82b-caa1-4ea9-a34f-05e170ce6471 for instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a on hv-cinder-85221 Aug 04 22:30:02.705711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-fdb4a9f1-2dea-4915-9520-8c12a0fdc072 req-2997a150-a5f6-4707-be3f-2778120b6221 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031221 Aug 04 22:30:02.706306 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 468/939] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:30:02.992378 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c4e1d48b-3433-49ef-9a50-4766d08e92a8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:02.992997 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c4e1d48b-3433-49ef-9a50-4766d08e92a8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:02.999575 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c4e1d48b-3433-49ef-9a50-4766d08e92a8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:03.000059 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c4e1d48b-3433-49ef-9a50-4766d08e92a8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:03.000498 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c4e1d48b-3433-49ef-9a50-4766d08e92a8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:03.001190 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c4e1d48b-3433-49ef-9a50-4766d08e92a8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:03.001684 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c4e1d48b-3433-49ef-9a50-4766d08e92a8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:03.002117 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c4e1d48b-3433-49ef-9a50-4766d08e92a8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:03.138117 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c4e1d48b-3433-49ef-9a50-4766d08e92a8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:03.145935 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c4e1d48b-3433-49ef-9a50-4766d08e92a8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:03.148065 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c4e1d48b-3433-49ef-9a50-4766d08e92a8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:03.149216 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c4e1d48b-3433-49ef-9a50-4766d08e92a8 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1751 microversion: 2.20 time: 0.160886 Aug 04 22:30:03.149817 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 472/940] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:02 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:04.172610 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-09c36f72-8ce3-4eb4-bb59-43616a5910b7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:04.173309 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-09c36f72-8ce3-4eb4-bb59-43616a5910b7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:04.180049 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-09c36f72-8ce3-4eb4-bb59-43616a5910b7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:04.180535 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-09c36f72-8ce3-4eb4-bb59-43616a5910b7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:04.180970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-09c36f72-8ce3-4eb4-bb59-43616a5910b7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:04.181702 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-09c36f72-8ce3-4eb4-bb59-43616a5910b7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:04.182160 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-09c36f72-8ce3-4eb4-bb59-43616a5910b7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:04.182586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-09c36f72-8ce3-4eb4-bb59-43616a5910b7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:04.312317 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-09c36f72-8ce3-4eb4-bb59-43616a5910b7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:04.320393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-09c36f72-8ce3-4eb4-bb59-43616a5910b7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:04.321934 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-09c36f72-8ce3-4eb4-bb59-43616a5910b7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:04.323092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-09c36f72-8ce3-4eb4-bb59-43616a5910b7 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1751 microversion: 2.20 time: 0.154721 Aug 04 22:30:04.323650 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 469/941] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:04 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:05.345193 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-2f2e31f7-fe6c-4024-b2f0-b8f8cef05adf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:05.346026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-2f2e31f7-fe6c-4024-b2f0-b8f8cef05adf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:05.353742 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2f2e31f7-fe6c-4024-b2f0-b8f8cef05adf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:05.354526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2f2e31f7-fe6c-4024-b2f0-b8f8cef05adf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:05.354985 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2f2e31f7-fe6c-4024-b2f0-b8f8cef05adf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:05.355957 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2f2e31f7-fe6c-4024-b2f0-b8f8cef05adf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:05.356437 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2f2e31f7-fe6c-4024-b2f0-b8f8cef05adf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:05.356848 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2f2e31f7-fe6c-4024-b2f0-b8f8cef05adf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:05.492939 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2f2e31f7-fe6c-4024-b2f0-b8f8cef05adf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:05.500873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2f2e31f7-fe6c-4024-b2f0-b8f8cef05adf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:05.502539 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2f2e31f7-fe6c-4024-b2f0-b8f8cef05adf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:05.503688 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-2f2e31f7-fe6c-4024-b2f0-b8f8cef05adf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1746 microversion: 2.20 time: 0.162494 Aug 04 22:30:05.504240 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 473/942] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:05 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:06.527476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-68327447-c94d-4d69-b9e6-1a9cde5f6666 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:06.528025 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-68327447-c94d-4d69-b9e6-1a9cde5f6666 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:06.536600 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-68327447-c94d-4d69-b9e6-1a9cde5f6666 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:06.537172 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-68327447-c94d-4d69-b9e6-1a9cde5f6666 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:06.539588 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-68327447-c94d-4d69-b9e6-1a9cde5f6666 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:06.540381 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-68327447-c94d-4d69-b9e6-1a9cde5f6666 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:06.541622 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-68327447-c94d-4d69-b9e6-1a9cde5f6666 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:06.542272 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-68327447-c94d-4d69-b9e6-1a9cde5f6666 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:06.706009 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-68327447-c94d-4d69-b9e6-1a9cde5f6666 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:06.716074 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-68327447-c94d-4d69-b9e6-1a9cde5f6666 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:06.717613 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-68327447-c94d-4d69-b9e6-1a9cde5f6666 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:06.718772 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-68327447-c94d-4d69-b9e6-1a9cde5f6666 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1746 microversion: 2.20 time: 0.195231 Aug 04 22:30:06.719324 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 470/943] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:06 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1746 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:07.743617 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-081b8a8d-1f9f-42af-8979-ad1cf5a1fc73 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:07.744229 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-081b8a8d-1f9f-42af-8979-ad1cf5a1fc73 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:07.751445 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-081b8a8d-1f9f-42af-8979-ad1cf5a1fc73 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:07.751944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-081b8a8d-1f9f-42af-8979-ad1cf5a1fc73 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:07.752371 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-081b8a8d-1f9f-42af-8979-ad1cf5a1fc73 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:07.753066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-081b8a8d-1f9f-42af-8979-ad1cf5a1fc73 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:07.753547 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-081b8a8d-1f9f-42af-8979-ad1cf5a1fc73 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:07.753968 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-081b8a8d-1f9f-42af-8979-ad1cf5a1fc73 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:07.909201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-081b8a8d-1f9f-42af-8979-ad1cf5a1fc73 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:07.918638 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-081b8a8d-1f9f-42af-8979-ad1cf5a1fc73 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:07.919819 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-081b8a8d-1f9f-42af-8979-ad1cf5a1fc73 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:07.920984 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-081b8a8d-1f9f-42af-8979-ad1cf5a1fc73 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1746 microversion: 2.20 time: 0.181792 Aug 04 22:30:07.921824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 474/944] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:07 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:08.326827 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ed79636c-0503-4998-b144-98a023f13ea1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:08.327388 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ed79636c-0503-4998-b144-98a023f13ea1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:08.335782 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ed79636c-0503-4998-b144-98a023f13ea1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:08.336433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ed79636c-0503-4998-b144-98a023f13ea1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:08.336885 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ed79636c-0503-4998-b144-98a023f13ea1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:08.337615 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ed79636c-0503-4998-b144-98a023f13ea1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:08.338070 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ed79636c-0503-4998-b144-98a023f13ea1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:08.338489 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ed79636c-0503-4998-b144-98a023f13ea1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:08.368335 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ed79636c-0503-4998-b144-98a023f13ea1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/ips" status: 200 len: 150 microversion: 2.1 time: 0.045648 Aug 04 22:30:08.368801 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 471/945] 10.222.0.109 () {58 vars in 1253 bytes} [Thu Aug 4 22:30:08 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:30:08.945855 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c8c79f67-d8ae-4371-9f76-a63cf5254be3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:08.946408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c8c79f67-d8ae-4371-9f76-a63cf5254be3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:08.952808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c8c79f67-d8ae-4371-9f76-a63cf5254be3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:08.953295 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c8c79f67-d8ae-4371-9f76-a63cf5254be3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:08.953764 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c8c79f67-d8ae-4371-9f76-a63cf5254be3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:08.954465 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c8c79f67-d8ae-4371-9f76-a63cf5254be3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:08.954923 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c8c79f67-d8ae-4371-9f76-a63cf5254be3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:08.955354 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c8c79f67-d8ae-4371-9f76-a63cf5254be3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:09.093624 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c8c79f67-d8ae-4371-9f76-a63cf5254be3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:09.103693 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c8c79f67-d8ae-4371-9f76-a63cf5254be3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:09.105876 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c8c79f67-d8ae-4371-9f76-a63cf5254be3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:09.107284 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c8c79f67-d8ae-4371-9f76-a63cf5254be3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1746 microversion: 2.20 time: 0.166673 Aug 04 22:30:09.124420 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 475/946] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:08 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1746 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:09.762339 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3e1a99c7-ff4b-4937-b46e-57df40eee462 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ac1aea0-8d57-4eb1-a18e-f805d2941f5e"}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:09.765014 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3e1a99c7-ff4b-4937-b46e-57df40eee462 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:09.768096 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=29 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:09.772500 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3e1a99c7-ff4b-4937-b46e-57df40eee462 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:09.773154 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3e1a99c7-ff4b-4937-b46e-57df40eee462 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:09.773632 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3e1a99c7-ff4b-4937-b46e-57df40eee462 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:09.774563 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3e1a99c7-ff4b-4937-b46e-57df40eee462 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:09.775060 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3e1a99c7-ff4b-4937-b46e-57df40eee462 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:09.775462 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3e1a99c7-ff4b-4937-b46e-57df40eee462 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:09.778454 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=77 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:10.092466 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3e1a99c7-ff4b-4937-b46e-57df40eee462 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "POST /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333553 Aug 04 22:30:10.093090 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 472/947] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:30:09 2022] POST /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:30:10.132850 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-68875869-c590-4cf9-adb1-8852f054d25d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:10.134152 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-68875869-c590-4cf9-adb1-8852f054d25d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:10.141652 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68875869-c590-4cf9-adb1-8852f054d25d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:10.142603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68875869-c590-4cf9-adb1-8852f054d25d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:10.143215 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68875869-c590-4cf9-adb1-8852f054d25d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:10.144448 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68875869-c590-4cf9-adb1-8852f054d25d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:10.145108 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68875869-c590-4cf9-adb1-8852f054d25d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:10.145776 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-68875869-c590-4cf9-adb1-8852f054d25d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:10.173867 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:10.312961 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-68875869-c590-4cf9-adb1-8852f054d25d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:10.323563 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-68875869-c590-4cf9-adb1-8852f054d25d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:10.325585 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-68875869-c590-4cf9-adb1-8852f054d25d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:10.327147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-68875869-c590-4cf9-adb1-8852f054d25d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1746 microversion: 2.20 time: 0.199042 Aug 04 22:30:10.327944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 476/948] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:10 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1746 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:11.353224 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2c3d5ad4-bc0f-4037-8528-0d3353508ff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:11.353968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2c3d5ad4-bc0f-4037-8528-0d3353508ff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:11.361133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2c3d5ad4-bc0f-4037-8528-0d3353508ff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:11.361662 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2c3d5ad4-bc0f-4037-8528-0d3353508ff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:11.362228 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2c3d5ad4-bc0f-4037-8528-0d3353508ff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:11.363013 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2c3d5ad4-bc0f-4037-8528-0d3353508ff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:11.363421 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2c3d5ad4-bc0f-4037-8528-0d3353508ff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:11.363850 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2c3d5ad4-bc0f-4037-8528-0d3353508ff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:11.569461 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2c3d5ad4-bc0f-4037-8528-0d3353508ff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:11.578424 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2c3d5ad4-bc0f-4037-8528-0d3353508ff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:11.580221 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2c3d5ad4-bc0f-4037-8528-0d3353508ff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:11.581645 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2c3d5ad4-bc0f-4037-8528-0d3353508ff9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1746 microversion: 2.20 time: 0.234249 Aug 04 22:30:11.582717 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 473/949] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:11 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1746 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:12.606913 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-03a98be2-74c7-4390-a628-18dfa128d7b5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:12.608198 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-03a98be2-74c7-4390-a628-18dfa128d7b5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:12.612094 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=31 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:12.617189 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03a98be2-74c7-4390-a628-18dfa128d7b5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:12.617719 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03a98be2-74c7-4390-a628-18dfa128d7b5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:12.618350 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03a98be2-74c7-4390-a628-18dfa128d7b5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:12.619237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03a98be2-74c7-4390-a628-18dfa128d7b5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:12.620174 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03a98be2-74c7-4390-a628-18dfa128d7b5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:12.620782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03a98be2-74c7-4390-a628-18dfa128d7b5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:12.779466 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-03a98be2-74c7-4390-a628-18dfa128d7b5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:12.789036 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-03a98be2-74c7-4390-a628-18dfa128d7b5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:12.790593 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-03a98be2-74c7-4390-a628-18dfa128d7b5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:12.791781 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-03a98be2-74c7-4390-a628-18dfa128d7b5 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1746 microversion: 2.20 time: 0.188975 Aug 04 22:30:12.805461 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 477/950] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:12 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1746 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:13.818179 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-5b61a89f-7989-46c8-bbdc-f63575667390 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:13.819412 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-5b61a89f-7989-46c8-bbdc-f63575667390 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:13.826929 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5b61a89f-7989-46c8-bbdc-f63575667390 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:13.827584 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5b61a89f-7989-46c8-bbdc-f63575667390 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:13.828324 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5b61a89f-7989-46c8-bbdc-f63575667390 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:13.829060 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5b61a89f-7989-46c8-bbdc-f63575667390 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:13.829559 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5b61a89f-7989-46c8-bbdc-f63575667390 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:13.829992 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5b61a89f-7989-46c8-bbdc-f63575667390 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:13.984948 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-5b61a89f-7989-46c8-bbdc-f63575667390 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:14.003409 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-5b61a89f-7989-46c8-bbdc-f63575667390 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:14.004928 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-5b61a89f-7989-46c8-bbdc-f63575667390 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:14.010187 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-5b61a89f-7989-46c8-bbdc-f63575667390 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1746 microversion: 2.20 time: 0.195718 Aug 04 22:30:14.010187 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 474/951] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:13 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1746 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:15.031172 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b3582e36-8f61-496b-b698-8a386eb8c694 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:15.031818 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b3582e36-8f61-496b-b698-8a386eb8c694 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:15.038926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3582e36-8f61-496b-b698-8a386eb8c694 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:15.039405 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3582e36-8f61-496b-b698-8a386eb8c694 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:15.039889 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3582e36-8f61-496b-b698-8a386eb8c694 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:15.040530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3582e36-8f61-496b-b698-8a386eb8c694 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:15.041008 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3582e36-8f61-496b-b698-8a386eb8c694 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:15.041456 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b3582e36-8f61-496b-b698-8a386eb8c694 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:15.226768 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b3582e36-8f61-496b-b698-8a386eb8c694 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:15.234614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b3582e36-8f61-496b-b698-8a386eb8c694 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:15.236123 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b3582e36-8f61-496b-b698-8a386eb8c694 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:15.237261 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b3582e36-8f61-496b-b698-8a386eb8c694 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1746 microversion: 2.20 time: 0.210018 Aug 04 22:30:15.237851 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 478/952] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:15 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1746 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:16.261048 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-8aca41f4-de06-4351-b2e3-3ae7a56c4c54 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:16.261605 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-8aca41f4-de06-4351-b2e3-3ae7a56c4c54 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:16.268113 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8aca41f4-de06-4351-b2e3-3ae7a56c4c54 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:16.268680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8aca41f4-de06-4351-b2e3-3ae7a56c4c54 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:16.269129 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8aca41f4-de06-4351-b2e3-3ae7a56c4c54 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:16.269867 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8aca41f4-de06-4351-b2e3-3ae7a56c4c54 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:16.270328 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8aca41f4-de06-4351-b2e3-3ae7a56c4c54 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:16.270781 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-8aca41f4-de06-4351-b2e3-3ae7a56c4c54 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:16.399181 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8aca41f4-de06-4351-b2e3-3ae7a56c4c54 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:16.406956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8aca41f4-de06-4351-b2e3-3ae7a56c4c54 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:16.408445 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-8aca41f4-de06-4351-b2e3-3ae7a56c4c54 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:16.409621 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-8aca41f4-de06-4351-b2e3-3ae7a56c4c54 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1728 microversion: 2.20 time: 0.153549 Aug 04 22:30:16.410175 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 475/953] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:16 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:17.566867 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3ea677e7-8d6d-406d-a7d4-6e6a2927080d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:17.567480 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3ea677e7-8d6d-406d-a7d4-6e6a2927080d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:17.574558 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3ea677e7-8d6d-406d-a7d4-6e6a2927080d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:17.575037 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3ea677e7-8d6d-406d-a7d4-6e6a2927080d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:17.575471 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3ea677e7-8d6d-406d-a7d4-6e6a2927080d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:17.576164 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3ea677e7-8d6d-406d-a7d4-6e6a2927080d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:17.576616 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3ea677e7-8d6d-406d-a7d4-6e6a2927080d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:17.577040 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3ea677e7-8d6d-406d-a7d4-6e6a2927080d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:17.702337 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-15bf5d44-80cc-4175-9728-23ffb0100818 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ac1aea0-8d57-4eb1-a18e-f805d2941f5e"}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:17.704797 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-15bf5d44-80cc-4175-9728-23ffb0100818 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:17.712527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-15bf5d44-80cc-4175-9728-23ffb0100818 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:17.713018 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-15bf5d44-80cc-4175-9728-23ffb0100818 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:17.713485 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-15bf5d44-80cc-4175-9728-23ffb0100818 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:17.714199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-15bf5d44-80cc-4175-9728-23ffb0100818 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:17.714659 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-15bf5d44-80cc-4175-9728-23ffb0100818 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:17.715089 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-15bf5d44-80cc-4175-9728-23ffb0100818 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:17.717376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3ea677e7-8d6d-406d-a7d4-6e6a2927080d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:17.725758 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3ea677e7-8d6d-406d-a7d4-6e6a2927080d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:17.727360 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3ea677e7-8d6d-406d-a7d4-6e6a2927080d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:17.728595 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3ea677e7-8d6d-406d-a7d4-6e6a2927080d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1728 microversion: 2.20 time: 0.299528 Aug 04 22:30:17.729221 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 479/954] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:17 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1728 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:17.793827 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-15bf5d44-80cc-4175-9728-23ffb0100818 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Invalid volume: volume 1ac1aea0-8d57-4eb1-a18e-f805d2941f5e is already attached to instances: b5faeb98-3d13-42e3-ac27-274501489586 Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-15bf5d44-80cc-4175-9728-23ffb0100818 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: POST /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-volume_attachments HTTP/1.1 Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 74 Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:30:17.795495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:30:17.797136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:30:17.797136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:30:17.797136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:30:17.797136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:30:17.797136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:30:17.797136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:30:17.797136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:30:17.797136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:30:17.797136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:30:17.797136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Aug 04 22:30:17.797136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {"volumeAttachment": {"volumeId": "1ac1aea0-8d57-4eb1-a18e-f805d2941f5e"}} Aug 04 22:30:17.797136 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Invalid volume: volume 1ac1aea0-8d57-4eb1-a18e-f805d2941f5e is already attached to instances: b5faeb98-3d13-42e3-ac27-274501489586 Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'server_id': 'b5faeb98-3d13-42e3-ac27-274501489586', 'body': {'volumeAttachment': {'volumeId': '1ac1aea0-8d57-4eb1-a18e-f805d2941f5e'}}} Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1ac1aea0-8d57-4eb1-a18e-f805d2941f5e is already attached to instances: b5faeb98-3d13-42e3-ac27-274501489586 Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:30:17.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1ac1aea0-8d57-4eb1-a18e-f805d2941f5e is already attached to instances: b5faeb98-3d13-42e3-ac27-274501489586 Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:30:17.799865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:30:17.801744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:30:17.801744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:30:17.801744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:30:17.801744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1ac1aea0-8d57-4eb1-a18e-f805d2941f5e is already attached to instances: b5faeb98-3d13-42e3-ac27-274501489586 Aug 04 22:30:17.801744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:30:17.801744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-15bf5d44-80cc-4175-9728-23ffb0100818 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 400 to user: Invalid volume: volume 1ac1aea0-8d57-4eb1-a18e-f805d2941f5e is already attached to instances: b5faeb98-3d13-42e3-ac27-274501489586 {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:30:17.801744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-15bf5d44-80cc-4175-9728-23ffb0100818 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "POST /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098903 Aug 04 22:30:17.801744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 476/955] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:30:17 2022] POST /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 22:30:17.860379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6c8e9fb1-8196-4496-8163-e34fb0ff077e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:17.860879 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6c8e9fb1-8196-4496-8163-e34fb0ff077e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:17.867425 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6c8e9fb1-8196-4496-8163-e34fb0ff077e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:17.867914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6c8e9fb1-8196-4496-8163-e34fb0ff077e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:17.868351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6c8e9fb1-8196-4496-8163-e34fb0ff077e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:17.869035 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6c8e9fb1-8196-4496-8163-e34fb0ff077e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:17.869537 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6c8e9fb1-8196-4496-8163-e34fb0ff077e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:17.869965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6c8e9fb1-8196-4496-8163-e34fb0ff077e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:17.950131 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-6c8e9fb1-8196-4496-8163-e34fb0ff077e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lazy-loading 'services' on Instance uuid b5faeb98-3d13-42e3-ac27-274501489586 {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:30:18.023991 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6c8e9fb1-8196-4496-8163-e34fb0ff077e tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-volume_attachments/1ac1aea0-8d57-4eb1-a18e-f805d2941f5e" status: 202 len: 0 microversion: 2.1 time: 0.167282 Aug 04 22:30:18.024820 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 480/956] 10.222.0.109 () {58 vars in 1421 bytes} [Thu Aug 4 22:30:17 2022] DELETE /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-volume_attachments/1ac1aea0-8d57-4eb1-a18e-f805d2941f5e => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:30:18.033115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-613b4fc8-6f5a-458c-be8a-4a6f93f9cfa1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:18.035311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-613b4fc8-6f5a-458c-be8a-4a6f93f9cfa1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:18.042721 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-613b4fc8-6f5a-458c-be8a-4a6f93f9cfa1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:18.043204 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-613b4fc8-6f5a-458c-be8a-4a6f93f9cfa1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:18.043639 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-613b4fc8-6f5a-458c-be8a-4a6f93f9cfa1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:18.044380 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-613b4fc8-6f5a-458c-be8a-4a6f93f9cfa1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:18.044784 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-613b4fc8-6f5a-458c-be8a-4a6f93f9cfa1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:18.045209 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-613b4fc8-6f5a-458c-be8a-4a6f93f9cfa1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:18.075225 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-613b4fc8-6f5a-458c-be8a-4a6f93f9cfa1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045997 Aug 04 22:30:18.075767 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 477/957] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:30:18 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:30:18.751941 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-22473b6a-399e-495c-ae72-5a2d2313cf69 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:18.752629 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-22473b6a-399e-495c-ae72-5a2d2313cf69 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:18.759435 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-22473b6a-399e-495c-ae72-5a2d2313cf69 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:18.760007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-22473b6a-399e-495c-ae72-5a2d2313cf69 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:18.760442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-22473b6a-399e-495c-ae72-5a2d2313cf69 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:18.761136 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-22473b6a-399e-495c-ae72-5a2d2313cf69 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:18.761608 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-22473b6a-399e-495c-ae72-5a2d2313cf69 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:18.762225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-22473b6a-399e-495c-ae72-5a2d2313cf69 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:18.854083 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-3a67f217-b81d-4768-9cb8-be4a2486d03d req-87b3707d-e3a4-41c6-a71e-da800cad87c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e61c4e-2c74-44c2-90bd-f997db2fbd0a", "name": "network-vif-unplugged", "status": "completed", "tag": "9bb4a82b-caa1-4ea9-a34f-05e170ce6471"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:18.872817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-3a67f217-b81d-4768-9cb8-be4a2486d03d req-87b3707d-e3a4-41c6-a71e-da800cad87c7 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:18.873388 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-3a67f217-b81d-4768-9cb8-be4a2486d03d req-87b3707d-e3a4-41c6-a71e-da800cad87c7 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:18.873903 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-3a67f217-b81d-4768-9cb8-be4a2486d03d req-87b3707d-e3a4-41c6-a71e-da800cad87c7 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:18.887687 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-3a67f217-b81d-4768-9cb8-be4a2486d03d req-87b3707d-e3a4-41c6-a71e-da800cad87c7 service nova] Creating event network-vif-unplugged:9bb4a82b-caa1-4ea9-a34f-05e170ce6471 for instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a on hv-cinder-85221 Aug 04 22:30:18.893051 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-3a67f217-b81d-4768-9cb8-be4a2486d03d req-87b3707d-e3a4-41c6-a71e-da800cad87c7 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043546 Aug 04 22:30:18.893883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 478/958] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:30:18.921247 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-22473b6a-399e-495c-ae72-5a2d2313cf69 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:18.930023 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-22473b6a-399e-495c-ae72-5a2d2313cf69 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:18.931505 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-22473b6a-399e-495c-ae72-5a2d2313cf69 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:18.932646 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-22473b6a-399e-495c-ae72-5a2d2313cf69 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1728 microversion: 2.20 time: 0.184990 Aug 04 22:30:18.933199 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 481/959] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:18 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:19.088011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f8687420-eb4d-4fdc-a776-ad0d9902ae77 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:19.090224 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f8687420-eb4d-4fdc-a776-ad0d9902ae77 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:19.096267 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f8687420-eb4d-4fdc-a776-ad0d9902ae77 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:19.096745 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f8687420-eb4d-4fdc-a776-ad0d9902ae77 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:19.097176 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f8687420-eb4d-4fdc-a776-ad0d9902ae77 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:19.097886 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f8687420-eb4d-4fdc-a776-ad0d9902ae77 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:19.098589 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f8687420-eb4d-4fdc-a776-ad0d9902ae77 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:19.099006 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f8687420-eb4d-4fdc-a776-ad0d9902ae77 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:19.128567 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f8687420-eb4d-4fdc-a776-ad0d9902ae77 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Aug 04 22:30:19.129123 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 479/960] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:30:19 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:30:19.955621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-33460196-56a5-453b-8f4d-b631b504d975 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:19.956230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-33460196-56a5-453b-8f4d-b631b504d975 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:19.963869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-33460196-56a5-453b-8f4d-b631b504d975 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:19.964354 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-33460196-56a5-453b-8f4d-b631b504d975 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:19.964789 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-33460196-56a5-453b-8f4d-b631b504d975 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:19.965517 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-33460196-56a5-453b-8f4d-b631b504d975 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:19.965974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-33460196-56a5-453b-8f4d-b631b504d975 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:19.966396 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-33460196-56a5-453b-8f4d-b631b504d975 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.098689 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-33460196-56a5-453b-8f4d-b631b504d975 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:20.107018 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-33460196-56a5-453b-8f4d-b631b504d975 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:20.108536 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-33460196-56a5-453b-8f4d-b631b504d975 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:20.109722 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-33460196-56a5-453b-8f4d-b631b504d975 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1671 microversion: 2.20 time: 0.158049 Aug 04 22:30:20.110458 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 482/961] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:19 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:20.133060 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-09e8f0b7-8c67-49c6-97f6-da3273358c50 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fb67ac6-03d5-4c0a-a666-76696090ff9f"}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:20.135357 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-09e8f0b7-8c67-49c6-97f6-da3273358c50 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:20.140399 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f8953ffa-b4f2-4e74-8820-5d2113d26d5c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:20.141749 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-09e8f0b7-8c67-49c6-97f6-da3273358c50 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.142233 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-09e8f0b7-8c67-49c6-97f6-da3273358c50 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.142668 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-09e8f0b7-8c67-49c6-97f6-da3273358c50 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.143228 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f8953ffa-b4f2-4e74-8820-5d2113d26d5c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:20.143353 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-09e8f0b7-8c67-49c6-97f6-da3273358c50 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.143793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-09e8f0b7-8c67-49c6-97f6-da3273358c50 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.144366 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-09e8f0b7-8c67-49c6-97f6-da3273358c50 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.149580 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8953ffa-b4f2-4e74-8820-5d2113d26d5c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.150153 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8953ffa-b4f2-4e74-8820-5d2113d26d5c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.150652 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8953ffa-b4f2-4e74-8820-5d2113d26d5c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.151439 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8953ffa-b4f2-4e74-8820-5d2113d26d5c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.151961 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8953ffa-b4f2-4e74-8820-5d2113d26d5c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.152470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f8953ffa-b4f2-4e74-8820-5d2113d26d5c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.181762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f8953ffa-b4f2-4e74-8820-5d2113d26d5c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045122 Aug 04 22:30:20.182330 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 483/962] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:30:20 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 22:30:20.249471 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-421998c5-ae7b-4d3c-8310-d4404ec75126 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:20.249973 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-421998c5-ae7b-4d3c-8310-d4404ec75126 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:20.257222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-421998c5-ae7b-4d3c-8310-d4404ec75126 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.257740 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-421998c5-ae7b-4d3c-8310-d4404ec75126 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.258172 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-421998c5-ae7b-4d3c-8310-d4404ec75126 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.258859 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-421998c5-ae7b-4d3c-8310-d4404ec75126 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.259303 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-421998c5-ae7b-4d3c-8310-d4404ec75126 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.259719 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-421998c5-ae7b-4d3c-8310-d4404ec75126 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.284574 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-421998c5-ae7b-4d3c-8310-d4404ec75126 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Going to try to terminate instance {{(pid=129196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:30:20.364243 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-421998c5-ae7b-4d3c-8310-d4404ec75126 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 204 len: 0 microversion: 2.1 time: 0.118120 Aug 04 22:30:20.365039 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 484/963] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:30:20 2022] DELETE /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 22:30:20.374852 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-bad3227a-26e1-470b-b557-6f4f0739ffbf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:20.375564 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-bad3227a-26e1-470b-b557-6f4f0739ffbf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:20.382028 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bad3227a-26e1-470b-b557-6f4f0739ffbf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.382517 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bad3227a-26e1-470b-b557-6f4f0739ffbf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.382957 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bad3227a-26e1-470b-b557-6f4f0739ffbf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.383666 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bad3227a-26e1-470b-b557-6f4f0739ffbf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.384170 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bad3227a-26e1-470b-b557-6f4f0739ffbf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.384543 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-bad3227a-26e1-470b-b557-6f4f0739ffbf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.415675 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-09e8f0b7-8c67-49c6-97f6-da3273358c50 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "POST /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287193 Aug 04 22:30:20.416312 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 480/964] 10.222.0.109 () {62 vars in 1369 bytes} [Thu Aug 4 22:30:20 2022] POST /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/os-volume_attachments => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 22:30:20.522718 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-bad3227a-26e1-470b-b557-6f4f0739ffbf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:20.530325 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-bad3227a-26e1-470b-b557-6f4f0739ffbf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1686 microversion: 2.1 time: 0.159578 Aug 04 22:30:20.530882 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 485/965] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:20 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:20.544355 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-73365447-abfb-40ca-9b11-768fc82dc05e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:20.544851 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-73365447-abfb-40ca-9b11-768fc82dc05e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:20.551822 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-73365447-abfb-40ca-9b11-768fc82dc05e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.552339 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-73365447-abfb-40ca-9b11-768fc82dc05e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.552800 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-73365447-abfb-40ca-9b11-768fc82dc05e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.553528 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-73365447-abfb-40ca-9b11-768fc82dc05e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.553978 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-73365447-abfb-40ca-9b11-768fc82dc05e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.554397 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-73365447-abfb-40ca-9b11-768fc82dc05e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.788998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-73365447-abfb-40ca-9b11-768fc82dc05e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "DELETE /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/os-volume_attachments/2fb67ac6-03d5-4c0a-a666-76696090ff9f" status: 202 len: 0 microversion: 2.20 time: 0.248917 Aug 04 22:30:20.789617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 481/966] 10.222.0.109 () {60 vars in 1462 bytes} [Thu Aug 4 22:30:20 2022] DELETE /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/os-volume_attachments/2fb67ac6-03d5-4c0a-a666-76696090ff9f => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 22:30:20.852947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b552426a-94f0-40b8-ab14-bff57b63670f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:20.853586 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b552426a-94f0-40b8-ab14-bff57b63670f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:20.859485 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b552426a-94f0-40b8-ab14-bff57b63670f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.859963 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b552426a-94f0-40b8-ab14-bff57b63670f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.860393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b552426a-94f0-40b8-ab14-bff57b63670f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.861071 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b552426a-94f0-40b8-ab14-bff57b63670f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.861563 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b552426a-94f0-40b8-ab14-bff57b63670f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.861989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b552426a-94f0-40b8-ab14-bff57b63670f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.890053 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b552426a-94f0-40b8-ab14-bff57b63670f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129196) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 22:30:20.957988 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b552426a-94f0-40b8-ab14-bff57b63670f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "POST /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/action" status: 202 len: 0 microversion: 2.20 time: 0.109440 Aug 04 22:30:20.962126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 486/967] 10.222.0.109 () {62 vars in 1324 bytes} [Thu Aug 4 22:30:20 2022] POST /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:30:20.967256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-95b27d53-4aa5-4cf0-bb80-6af3a5bc7d47 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:20.967862 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-95b27d53-4aa5-4cf0-bb80-6af3a5bc7d47 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:20.977288 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-95b27d53-4aa5-4cf0-bb80-6af3a5bc7d47 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.977814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-95b27d53-4aa5-4cf0-bb80-6af3a5bc7d47 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.978246 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-95b27d53-4aa5-4cf0-bb80-6af3a5bc7d47 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:20.978955 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-95b27d53-4aa5-4cf0-bb80-6af3a5bc7d47 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:20.979397 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-95b27d53-4aa5-4cf0-bb80-6af3a5bc7d47 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:20.979819 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-95b27d53-4aa5-4cf0-bb80-6af3a5bc7d47 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:21.157968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-95b27d53-4aa5-4cf0-bb80-6af3a5bc7d47 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:21.162705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=10,nova_cell1:INSERT=6 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:21.168416 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-95b27d53-4aa5-4cf0-bb80-6af3a5bc7d47 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:21.169971 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-95b27d53-4aa5-4cf0-bb80-6af3a5bc7d47 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:21.171143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-95b27d53-4aa5-4cf0-bb80-6af3a5bc7d47 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1679 microversion: 2.20 time: 0.207816 Aug 04 22:30:21.171710 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 482/968] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:20 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:30:21.551819 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-003b81f1-58a9-44ab-9dd8-9cad31a2bc63 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:21.552392 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-003b81f1-58a9-44ab-9dd8-9cad31a2bc63 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:21.559697 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-003b81f1-58a9-44ab-9dd8-9cad31a2bc63 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:21.560185 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-003b81f1-58a9-44ab-9dd8-9cad31a2bc63 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:21.560625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-003b81f1-58a9-44ab-9dd8-9cad31a2bc63 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:21.561318 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-003b81f1-58a9-44ab-9dd8-9cad31a2bc63 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:21.561804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-003b81f1-58a9-44ab-9dd8-9cad31a2bc63 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:21.562229 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-003b81f1-58a9-44ab-9dd8-9cad31a2bc63 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:21.688714 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-003b81f1-58a9-44ab-9dd8-9cad31a2bc63 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:21.697046 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-003b81f1-58a9-44ab-9dd8-9cad31a2bc63 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1686 microversion: 2.1 time: 0.149208 Aug 04 22:30:21.697658 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 487/969] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:21 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:22.193869 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2b69414b-43ea-4be4-9ad1-f7b3d03a3579 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:22.194454 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2b69414b-43ea-4be4-9ad1-f7b3d03a3579 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:22.202418 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2b69414b-43ea-4be4-9ad1-f7b3d03a3579 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:22.202911 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2b69414b-43ea-4be4-9ad1-f7b3d03a3579 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:22.203349 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2b69414b-43ea-4be4-9ad1-f7b3d03a3579 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:22.204041 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2b69414b-43ea-4be4-9ad1-f7b3d03a3579 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:22.204495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2b69414b-43ea-4be4-9ad1-f7b3d03a3579 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:22.204920 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2b69414b-43ea-4be4-9ad1-f7b3d03a3579 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:22.335278 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2b69414b-43ea-4be4-9ad1-f7b3d03a3579 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:22.343055 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2b69414b-43ea-4be4-9ad1-f7b3d03a3579 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:22.344552 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2b69414b-43ea-4be4-9ad1-f7b3d03a3579 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:22.345717 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2b69414b-43ea-4be4-9ad1-f7b3d03a3579 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.156047 Aug 04 22:30:22.346330 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 483/970] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:22 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:22.719265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a71ec172-50a1-4eb2-a3b2-b58cca9f9c02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:22.719963 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a71ec172-50a1-4eb2-a3b2-b58cca9f9c02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:22.727057 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a71ec172-50a1-4eb2-a3b2-b58cca9f9c02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:22.727678 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a71ec172-50a1-4eb2-a3b2-b58cca9f9c02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:22.728234 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a71ec172-50a1-4eb2-a3b2-b58cca9f9c02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:22.729031 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a71ec172-50a1-4eb2-a3b2-b58cca9f9c02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:22.729616 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a71ec172-50a1-4eb2-a3b2-b58cca9f9c02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:22.730134 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a71ec172-50a1-4eb2-a3b2-b58cca9f9c02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:23.226485 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a71ec172-50a1-4eb2-a3b2-b58cca9f9c02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:23.234682 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a71ec172-50a1-4eb2-a3b2-b58cca9f9c02 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 200 len: 1686 microversion: 2.1 time: 0.519228 Aug 04 22:30:23.240246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 488/971] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:22 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 1686 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:23.373248 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e0bcac2c-dd04-4bad-a4cc-75dba43852eb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:23.373986 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e0bcac2c-dd04-4bad-a4cc-75dba43852eb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:23.383895 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0bcac2c-dd04-4bad-a4cc-75dba43852eb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:23.384391 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0bcac2c-dd04-4bad-a4cc-75dba43852eb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:23.384790 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0bcac2c-dd04-4bad-a4cc-75dba43852eb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:23.386592 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0bcac2c-dd04-4bad-a4cc-75dba43852eb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:23.387057 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0bcac2c-dd04-4bad-a4cc-75dba43852eb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:23.387477 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e0bcac2c-dd04-4bad-a4cc-75dba43852eb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:23.461047 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-7427e559-ca5e-402d-951c-e0983a8c8051 req-4e4f6525-600e-4573-b520-cc9caa74d096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5faeb98-3d13-42e3-ac27-274501489586", "name": "network-vif-deleted", "tag": "de78c712-58d3-4973-b307-75b8ab84d687"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:23.473442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-7427e559-ca5e-402d-951c-e0983a8c8051 req-4e4f6525-600e-4573-b520-cc9caa74d096 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:23.475046 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-7427e559-ca5e-402d-951c-e0983a8c8051 req-4e4f6525-600e-4573-b520-cc9caa74d096 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:23.476029 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-7427e559-ca5e-402d-951c-e0983a8c8051 req-4e4f6525-600e-4573-b520-cc9caa74d096 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:23.492148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-7427e559-ca5e-402d-951c-e0983a8c8051 req-4e4f6525-600e-4573-b520-cc9caa74d096 service nova] Creating event network-vif-deleted:de78c712-58d3-4973-b307-75b8ab84d687 for instance b5faeb98-3d13-42e3-ac27-274501489586 on hv-cinder-85221 Aug 04 22:30:23.506467 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-7427e559-ca5e-402d-951c-e0983a8c8051 req-4e4f6525-600e-4573-b520-cc9caa74d096 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045234 Aug 04 22:30:23.507388 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 489/972] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:30:23.585187 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e0bcac2c-dd04-4bad-a4cc-75dba43852eb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:23.594261 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e0bcac2c-dd04-4bad-a4cc-75dba43852eb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:23.596025 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e0bcac2c-dd04-4bad-a4cc-75dba43852eb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:23.597202 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e0bcac2c-dd04-4bad-a4cc-75dba43852eb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.231705 Aug 04 22:30:23.598370 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 484/973] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:23 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:24.257896 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-48e1e3d0-c47f-41ef-9bb9-20064a4d8a91 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:24.258625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-48e1e3d0-c47f-41ef-9bb9-20064a4d8a91 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:24.265279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-48e1e3d0-c47f-41ef-9bb9-20064a4d8a91 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:24.265812 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-48e1e3d0-c47f-41ef-9bb9-20064a4d8a91 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:24.266241 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-48e1e3d0-c47f-41ef-9bb9-20064a4d8a91 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:24.266937 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-48e1e3d0-c47f-41ef-9bb9-20064a4d8a91 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:24.267385 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-48e1e3d0-c47f-41ef-9bb9-20064a4d8a91 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:24.268236 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-48e1e3d0-c47f-41ef-9bb9-20064a4d8a91 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:24.282861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-48e1e3d0-c47f-41ef-9bb9-20064a4d8a91 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-48e1e3d0-c47f-41ef-9bb9-20064a4d8a91 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 HTTP/1.1 Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:30:24.284621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:30:24.286244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:30:24.286244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:30:24.286244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:30:24.286244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:30:24.286244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:30:24.286244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:30:24.286244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:30:24.286244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:30:24.286244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:30:24.286244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:30:24.286244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:30:24.286244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'b5faeb98-3d13-42e3-ac27-274501489586'} Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:30:24.287530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:30:24.289159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:30:24.290329 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-48e1e3d0-c47f-41ef-9bb9-20064a4d8a91 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 404 to user: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:30:24.290329 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-48e1e3d0-c47f-41ef-9bb9-20064a4d8a91 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 404 len: 111 microversion: 2.1 time: 0.033868 Aug 04 22:30:24.290329 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 490/974] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:24 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:30:24.297483 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e7d56b09-2f8c-43f3-8846-d555c73c349b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '.version_select at 0x7fe7b186ff70>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:24.322660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e7d56b09-2f8c-43f3-8846-d555c73c349b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-356446245" status: 202 len: 0 microversion: 2.1 time: 0.029046 Aug 04 22:30:24.324065 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 485/975] 10.222.0.109 () {58 vars in 1223 bytes} [Thu Aug 4 22:30:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-356446245 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:30:24.621483 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-98d22adc-f55b-4ae9-97f5-53d230096639 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:24.622734 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-98d22adc-f55b-4ae9-97f5-53d230096639 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:24.633324 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98d22adc-f55b-4ae9-97f5-53d230096639 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:24.635126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98d22adc-f55b-4ae9-97f5-53d230096639 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:24.636036 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98d22adc-f55b-4ae9-97f5-53d230096639 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:24.637005 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98d22adc-f55b-4ae9-97f5-53d230096639 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:24.637714 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98d22adc-f55b-4ae9-97f5-53d230096639 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:24.638436 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98d22adc-f55b-4ae9-97f5-53d230096639 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:24.644120 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:25.015261 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-98d22adc-f55b-4ae9-97f5-53d230096639 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:25.027225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-98d22adc-f55b-4ae9-97f5-53d230096639 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:25.028818 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-98d22adc-f55b-4ae9-97f5-53d230096639 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:25.030122 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-98d22adc-f55b-4ae9-97f5-53d230096639 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.413052 Aug 04 22:30:25.030805 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 491/976] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:24 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:30:25.349796 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-de7736e4-1d1c-429f-a5af-a6b18cedebc7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Action: 'create', calling method: .version_select at 0x7fe7b178a670>, body: {"keypair": {"name": "tempest-keypair-2131270065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpibsnHG9UJjJe2nHEZfQRB4MNmWm0CHiJ49q1BkKMx69TGL6wlsdcIhmPxteXSI4Poux+8PCMZ58k+A+4oviHnBbIMInSphzxRiKyunU6NMBou+xEdvqfv5I9oJNdFLQ=="}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:25.367643 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-de7736e4-1d1c-429f-a5af-a6b18cedebc7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for project 011b296da6654fa38f76eadd7bebae6f. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:30:25.371510 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-de7736e4-1d1c-429f-a5af-a6b18cedebc7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for user 8c50160e51b54cde9a3f617d71fbf1c0 and project 011b296da6654fa38f76eadd7bebae6f. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:30:25.394125 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-de7736e4-1d1c-429f-a5af-a6b18cedebc7 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049680 Aug 04 22:30:25.394727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 486/977] 10.222.0.109 () {60 vars in 1164 bytes} [Thu Aug 4 22:30:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:30:26.055576 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8fe52020-5a98-48c6-993b-7db9d1e0ea00 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:26.056421 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8fe52020-5a98-48c6-993b-7db9d1e0ea00 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:26.064514 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fe52020-5a98-48c6-993b-7db9d1e0ea00 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:26.065469 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fe52020-5a98-48c6-993b-7db9d1e0ea00 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:26.066119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fe52020-5a98-48c6-993b-7db9d1e0ea00 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:26.067567 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fe52020-5a98-48c6-993b-7db9d1e0ea00 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:26.069509 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fe52020-5a98-48c6-993b-7db9d1e0ea00 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:26.070447 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fe52020-5a98-48c6-993b-7db9d1e0ea00 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:26.267370 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8fe52020-5a98-48c6-993b-7db9d1e0ea00 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:26.277940 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8fe52020-5a98-48c6-993b-7db9d1e0ea00 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:26.279450 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8fe52020-5a98-48c6-993b-7db9d1e0ea00 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:26.280616 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8fe52020-5a98-48c6-993b-7db9d1e0ea00 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.230144 Aug 04 22:30:26.281507 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 492/978] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:26 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:26.890942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1647972769", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b91150e-ffb3-48d1-826e-331e5df87d0e"}], "security_groups": [{"name": "tempest-securitygroup--1993611057"}], "key_name": "tempest-keypair-2131270065", "user_data": "}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:27.006781 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.network.neutron [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] validate_networks() for [('7b91150e-ffb3-48d1-826e-331e5df87d0e', None, None, None, None, None)] {{(pid=129197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:30:27.305990 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3e4f3aed-fa68-4b89-b12b-6d6ddb32466d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:27.307869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3e4f3aed-fa68-4b89-b12b-6d6ddb32466d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:27.315237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e4f3aed-fa68-4b89-b12b-6d6ddb32466d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:27.316019 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e4f3aed-fa68-4b89-b12b-6d6ddb32466d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:27.316461 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e4f3aed-fa68-4b89-b12b-6d6ddb32466d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:27.317230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e4f3aed-fa68-4b89-b12b-6d6ddb32466d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:27.319152 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e4f3aed-fa68-4b89-b12b-6d6ddb32466d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:27.319798 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3e4f3aed-fa68-4b89-b12b-6d6ddb32466d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:27.470856 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Flavor limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:30:27.471289 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Image limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:30:27.471764 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Flavor pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:30:27.472178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Image pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:30:27.472592 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:30:27.474736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3e4f3aed-fa68-4b89-b12b-6d6ddb32466d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:27.483149 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3e4f3aed-fa68-4b89-b12b-6d6ddb32466d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:27.484648 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3e4f3aed-fa68-4b89-b12b-6d6ddb32466d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:27.485846 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3e4f3aed-fa68-4b89-b12b-6d6ddb32466d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.186070 Aug 04 22:30:27.486974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 493/979] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:27 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:27.489940 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:27.490637 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:27.491079 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:27.491813 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:27.492419 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:27.492970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:27.510984 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for project 011b296da6654fa38f76eadd7bebae6f. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:30:27.515199 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Getting quotas for user 8c50160e51b54cde9a3f617d71fbf1c0 and project 011b296da6654fa38f76eadd7bebae6f. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:30:27.527452 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Going to run 1 instances... {{(pid=129197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:30:27.529820 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:30:27.584732 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c1f87cfa-dd9a-4c04-ba00-ae3c58b9b5ad tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.698691 Aug 04 22:30:27.585382 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 487/980] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:30:26 2022] POST /compute/v2.1/servers => generated 404 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:30:27.596603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f965648f-a77f-4f61-9447-37091f283b86 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:27.597246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f965648f-a77f-4f61-9447-37091f283b86 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:27.659795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f965648f-a77f-4f61-9447-37091f283b86 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:27.668842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f965648f-a77f-4f61-9447-37091f283b86 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1246 microversion: 2.1 time: 0.076232 Aug 04 22:30:27.669972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 494/981] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:27 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:28.511457 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b7f39c8f-dff8-46d1-ac80-124a94a912b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:28.512842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b7f39c8f-dff8-46d1-ac80-124a94a912b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:28.518882 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b7f39c8f-dff8-46d1-ac80-124a94a912b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:28.519385 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b7f39c8f-dff8-46d1-ac80-124a94a912b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:28.519815 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b7f39c8f-dff8-46d1-ac80-124a94a912b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:28.520509 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b7f39c8f-dff8-46d1-ac80-124a94a912b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:28.521107 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b7f39c8f-dff8-46d1-ac80-124a94a912b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:28.521541 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b7f39c8f-dff8-46d1-ac80-124a94a912b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:28.663932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b7f39c8f-dff8-46d1-ac80-124a94a912b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:28.672636 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b7f39c8f-dff8-46d1-ac80-124a94a912b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:28.674177 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b7f39c8f-dff8-46d1-ac80-124a94a912b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:28.675550 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b7f39c8f-dff8-46d1-ac80-124a94a912b4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.168460 Aug 04 22:30:28.679243 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 488/982] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:28 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:28.690624 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-27289620-3759-47b0-af4b-02870ea60e23 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:28.691995 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-27289620-3759-47b0-af4b-02870ea60e23 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:28.700162 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-27289620-3759-47b0-af4b-02870ea60e23 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:28.700653 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-27289620-3759-47b0-af4b-02870ea60e23 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:28.701092 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-27289620-3759-47b0-af4b-02870ea60e23 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:28.701857 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-27289620-3759-47b0-af4b-02870ea60e23 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:28.702344 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-27289620-3759-47b0-af4b-02870ea60e23 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:28.702743 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-27289620-3759-47b0-af4b-02870ea60e23 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:28.775712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-27289620-3759-47b0-af4b-02870ea60e23 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:28.783118 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-27289620-3759-47b0-af4b-02870ea60e23 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1250 microversion: 2.1 time: 0.096366 Aug 04 22:30:28.783679 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 495/983] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:28 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1250 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:29.698881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-516418f5-85da-4877-8f72-e6b5b2fce16e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:29.700283 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-516418f5-85da-4877-8f72-e6b5b2fce16e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:29.707817 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-516418f5-85da-4877-8f72-e6b5b2fce16e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:29.709098 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-516418f5-85da-4877-8f72-e6b5b2fce16e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:29.709901 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-516418f5-85da-4877-8f72-e6b5b2fce16e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:29.710801 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-516418f5-85da-4877-8f72-e6b5b2fce16e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:29.711425 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-516418f5-85da-4877-8f72-e6b5b2fce16e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:29.712026 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-516418f5-85da-4877-8f72-e6b5b2fce16e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:29.806421 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c73386ed-a36f-46de-ad26-6c2657afd11f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:29.807049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c73386ed-a36f-46de-ad26-6c2657afd11f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:29.824718 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c73386ed-a36f-46de-ad26-6c2657afd11f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:29.825207 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c73386ed-a36f-46de-ad26-6c2657afd11f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:29.825665 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c73386ed-a36f-46de-ad26-6c2657afd11f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:29.826376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c73386ed-a36f-46de-ad26-6c2657afd11f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:29.826828 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c73386ed-a36f-46de-ad26-6c2657afd11f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:29.827262 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c73386ed-a36f-46de-ad26-6c2657afd11f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:29.873649 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-516418f5-85da-4877-8f72-e6b5b2fce16e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:29.882842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-516418f5-85da-4877-8f72-e6b5b2fce16e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:29.884340 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-516418f5-85da-4877-8f72-e6b5b2fce16e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:29.885702 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-516418f5-85da-4877-8f72-e6b5b2fce16e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.190746 Aug 04 22:30:29.892721 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 489/984] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:29 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:29.898778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c73386ed-a36f-46de-ad26-6c2657afd11f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:29.907758 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c73386ed-a36f-46de-ad26-6c2657afd11f tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1250 microversion: 2.1 time: 0.105698 Aug 04 22:30:29.908530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 496/985] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:29 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1250 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:30.910057 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c7ae8ade-92b7-4613-a03b-336df377a905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:30.912351 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c7ae8ade-92b7-4613-a03b-336df377a905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:30.918219 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c7ae8ade-92b7-4613-a03b-336df377a905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:30.918704 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c7ae8ade-92b7-4613-a03b-336df377a905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:30.919139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c7ae8ade-92b7-4613-a03b-336df377a905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:30.919836 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c7ae8ade-92b7-4613-a03b-336df377a905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:30.920316 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c7ae8ade-92b7-4613-a03b-336df377a905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:30.920740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c7ae8ade-92b7-4613-a03b-336df377a905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:31.007145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-95f11290-a99e-4b65-9e36-6a3162fdd469 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:31.008226 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-95f11290-a99e-4b65-9e36-6a3162fdd469 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:31.014613 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95f11290-a99e-4b65-9e36-6a3162fdd469 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:31.015031 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95f11290-a99e-4b65-9e36-6a3162fdd469 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:31.015482 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95f11290-a99e-4b65-9e36-6a3162fdd469 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:31.016166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95f11290-a99e-4b65-9e36-6a3162fdd469 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:31.016613 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95f11290-a99e-4b65-9e36-6a3162fdd469 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:31.017035 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-95f11290-a99e-4b65-9e36-6a3162fdd469 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:31.082136 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-95f11290-a99e-4b65-9e36-6a3162fdd469 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:31.092343 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-95f11290-a99e-4b65-9e36-6a3162fdd469 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1250 microversion: 2.1 time: 0.168057 Aug 04 22:30:31.095955 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 497/986] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:30 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1250 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:30:31.097065 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c7ae8ade-92b7-4613-a03b-336df377a905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:31.125377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c7ae8ade-92b7-4613-a03b-336df377a905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:31.127005 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c7ae8ade-92b7-4613-a03b-336df377a905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:31.128298 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c7ae8ade-92b7-4613-a03b-336df377a905 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.222318 Aug 04 22:30:31.129237 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 490/987] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:30 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:32.119055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-63f81316-bd18-4404-818d-b31c36dfc886 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:32.120196 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-63f81316-bd18-4404-818d-b31c36dfc886 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:32.130850 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-63f81316-bd18-4404-818d-b31c36dfc886 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:32.131752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-63f81316-bd18-4404-818d-b31c36dfc886 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:32.132364 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-63f81316-bd18-4404-818d-b31c36dfc886 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:32.133326 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-63f81316-bd18-4404-818d-b31c36dfc886 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:32.133979 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-63f81316-bd18-4404-818d-b31c36dfc886 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:32.134596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-63f81316-bd18-4404-818d-b31c36dfc886 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:32.153119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-17569381-e61d-4fa0-aeb0-5eb498a5fc36 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:32.163723 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-17569381-e61d-4fa0-aeb0-5eb498a5fc36 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:32.177066 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-17569381-e61d-4fa0-aeb0-5eb498a5fc36 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:32.177540 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-17569381-e61d-4fa0-aeb0-5eb498a5fc36 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:32.178784 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-17569381-e61d-4fa0-aeb0-5eb498a5fc36 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:32.179577 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-17569381-e61d-4fa0-aeb0-5eb498a5fc36 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:32.181800 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-17569381-e61d-4fa0-aeb0-5eb498a5fc36 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:32.182433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-17569381-e61d-4fa0-aeb0-5eb498a5fc36 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:32.221212 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-63f81316-bd18-4404-818d-b31c36dfc886 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:32.230747 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-63f81316-bd18-4404-818d-b31c36dfc886 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1250 microversion: 2.1 time: 0.116234 Aug 04 22:30:32.250450 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 498/988] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:32 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1250 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:32.383187 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-17569381-e61d-4fa0-aeb0-5eb498a5fc36 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:32.403821 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-17569381-e61d-4fa0-aeb0-5eb498a5fc36 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:32.406796 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-17569381-e61d-4fa0-aeb0-5eb498a5fc36 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:32.409092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-17569381-e61d-4fa0-aeb0-5eb498a5fc36 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.260032 Aug 04 22:30:32.425970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 491/989] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:32 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:33.256316 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4826f2da-1446-4040-bf75-5fa87804e492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:33.256890 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4826f2da-1446-4040-bf75-5fa87804e492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:33.263903 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4826f2da-1446-4040-bf75-5fa87804e492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:33.264406 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4826f2da-1446-4040-bf75-5fa87804e492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:33.264845 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4826f2da-1446-4040-bf75-5fa87804e492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:33.265592 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4826f2da-1446-4040-bf75-5fa87804e492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:33.266085 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4826f2da-1446-4040-bf75-5fa87804e492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:33.266534 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4826f2da-1446-4040-bf75-5fa87804e492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:33.335461 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4826f2da-1446-4040-bf75-5fa87804e492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:33.343423 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4826f2da-1446-4040-bf75-5fa87804e492 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1250 microversion: 2.1 time: 0.091276 Aug 04 22:30:33.343992 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 499/990] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:33 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1250 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:33.434001 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-24adc345-56d6-41a8-844d-43ad0e965a4b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:33.434604 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-24adc345-56d6-41a8-844d-43ad0e965a4b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:33.441230 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-24adc345-56d6-41a8-844d-43ad0e965a4b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:33.441771 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-24adc345-56d6-41a8-844d-43ad0e965a4b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:33.442398 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-24adc345-56d6-41a8-844d-43ad0e965a4b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:33.443151 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-24adc345-56d6-41a8-844d-43ad0e965a4b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:33.443614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-24adc345-56d6-41a8-844d-43ad0e965a4b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:33.444050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-24adc345-56d6-41a8-844d-43ad0e965a4b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:33.591074 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-24adc345-56d6-41a8-844d-43ad0e965a4b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:33.600549 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-24adc345-56d6-41a8-844d-43ad0e965a4b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:33.602155 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-24adc345-56d6-41a8-844d-43ad0e965a4b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:33.603334 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-24adc345-56d6-41a8-844d-43ad0e965a4b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.173278 Aug 04 22:30:33.603898 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 492/991] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:33 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:34.364362 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-801cf8e0-4a56-432d-96ec-97c6c7ab058a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:34.364906 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-801cf8e0-4a56-432d-96ec-97c6c7ab058a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:34.371485 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-801cf8e0-4a56-432d-96ec-97c6c7ab058a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:34.371974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-801cf8e0-4a56-432d-96ec-97c6c7ab058a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:34.372411 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-801cf8e0-4a56-432d-96ec-97c6c7ab058a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:34.373109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-801cf8e0-4a56-432d-96ec-97c6c7ab058a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:34.373630 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-801cf8e0-4a56-432d-96ec-97c6c7ab058a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:34.374057 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-801cf8e0-4a56-432d-96ec-97c6c7ab058a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:34.437132 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-801cf8e0-4a56-432d-96ec-97c6c7ab058a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:34.444933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-801cf8e0-4a56-432d-96ec-97c6c7ab058a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1250 microversion: 2.1 time: 0.084595 Aug 04 22:30:34.445529 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 500/992] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:34 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:34.626657 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-adf16446-a137-41f4-ba9c-0395d64b56bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:34.627202 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-adf16446-a137-41f4-ba9c-0395d64b56bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:34.634590 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-adf16446-a137-41f4-ba9c-0395d64b56bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:34.635078 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-adf16446-a137-41f4-ba9c-0395d64b56bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:34.635508 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-adf16446-a137-41f4-ba9c-0395d64b56bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:34.636204 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-adf16446-a137-41f4-ba9c-0395d64b56bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:34.636651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-adf16446-a137-41f4-ba9c-0395d64b56bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:34.637068 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-adf16446-a137-41f4-ba9c-0395d64b56bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:34.781004 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-adf16446-a137-41f4-ba9c-0395d64b56bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:34.792019 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-adf16446-a137-41f4-ba9c-0395d64b56bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:34.793537 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-adf16446-a137-41f4-ba9c-0395d64b56bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:34.794739 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-adf16446-a137-41f4-ba9c-0395d64b56bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.172138 Aug 04 22:30:34.795298 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 493/993] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:34 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:35.466191 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-2899e2b0-b28b-4548-be37-9bb9b49e55b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:35.466813 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-2899e2b0-b28b-4548-be37-9bb9b49e55b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:35.474379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2899e2b0-b28b-4548-be37-9bb9b49e55b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:35.474987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2899e2b0-b28b-4548-be37-9bb9b49e55b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:35.475554 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2899e2b0-b28b-4548-be37-9bb9b49e55b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:35.476528 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2899e2b0-b28b-4548-be37-9bb9b49e55b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:35.476985 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2899e2b0-b28b-4548-be37-9bb9b49e55b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:35.477432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2899e2b0-b28b-4548-be37-9bb9b49e55b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:35.541573 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2899e2b0-b28b-4548-be37-9bb9b49e55b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:35.549145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-2899e2b0-b28b-4548-be37-9bb9b49e55b2 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1250 microversion: 2.1 time: 0.086819 Aug 04 22:30:35.549757 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 501/994] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:35 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1250 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:35.818454 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-92e18bf9-96ad-42f8-81f1-29a404d986c4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:35.819002 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-92e18bf9-96ad-42f8-81f1-29a404d986c4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:35.826879 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-92e18bf9-96ad-42f8-81f1-29a404d986c4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:35.827364 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-92e18bf9-96ad-42f8-81f1-29a404d986c4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:35.827799 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-92e18bf9-96ad-42f8-81f1-29a404d986c4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:35.828500 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-92e18bf9-96ad-42f8-81f1-29a404d986c4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:35.828991 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-92e18bf9-96ad-42f8-81f1-29a404d986c4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:35.829426 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-92e18bf9-96ad-42f8-81f1-29a404d986c4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:35.966527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-92e18bf9-96ad-42f8-81f1-29a404d986c4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:35.975831 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-92e18bf9-96ad-42f8-81f1-29a404d986c4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:35.977320 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-92e18bf9-96ad-42f8-81f1-29a404d986c4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:35.978570 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-92e18bf9-96ad-42f8-81f1-29a404d986c4 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.164835 Aug 04 22:30:35.979126 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 494/995] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:35 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:30:36.571100 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-17efa4f1-a12e-42f2-b9b3-acab7e0a46ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:36.571645 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-17efa4f1-a12e-42f2-b9b3-acab7e0a46ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:36.578576 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-17efa4f1-a12e-42f2-b9b3-acab7e0a46ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:36.579065 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-17efa4f1-a12e-42f2-b9b3-acab7e0a46ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:36.579530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-17efa4f1-a12e-42f2-b9b3-acab7e0a46ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:36.580254 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-17efa4f1-a12e-42f2-b9b3-acab7e0a46ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:36.580716 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-17efa4f1-a12e-42f2-b9b3-acab7e0a46ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:36.581140 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-17efa4f1-a12e-42f2-b9b3-acab7e0a46ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:36.644869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-17efa4f1-a12e-42f2-b9b3-acab7e0a46ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:36.653074 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-17efa4f1-a12e-42f2-b9b3-acab7e0a46ab tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1242 microversion: 2.1 time: 0.086343 Aug 04 22:30:36.653687 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 502/996] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:36 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:37.001540 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d24f84bc-0caa-45f5-b443-63ed439a1fbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:37.002157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d24f84bc-0caa-45f5-b443-63ed439a1fbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:37.008927 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d24f84bc-0caa-45f5-b443-63ed439a1fbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:37.009435 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d24f84bc-0caa-45f5-b443-63ed439a1fbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:37.009904 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d24f84bc-0caa-45f5-b443-63ed439a1fbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:37.010816 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d24f84bc-0caa-45f5-b443-63ed439a1fbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:37.011269 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d24f84bc-0caa-45f5-b443-63ed439a1fbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:37.011700 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d24f84bc-0caa-45f5-b443-63ed439a1fbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:37.147729 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d24f84bc-0caa-45f5-b443-63ed439a1fbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:37.156007 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d24f84bc-0caa-45f5-b443-63ed439a1fbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:37.158739 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d24f84bc-0caa-45f5-b443-63ed439a1fbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:37.160125 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d24f84bc-0caa-45f5-b443-63ed439a1fbb tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.162581 Aug 04 22:30:37.161261 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 495/997] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:36 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:37.675478 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a4641943-0953-4276-9aff-ca6c465de8e9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:37.676136 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a4641943-0953-4276-9aff-ca6c465de8e9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:37.679109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:37.684329 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a4641943-0953-4276-9aff-ca6c465de8e9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:37.684817 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a4641943-0953-4276-9aff-ca6c465de8e9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:37.685255 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a4641943-0953-4276-9aff-ca6c465de8e9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:37.685987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a4641943-0953-4276-9aff-ca6c465de8e9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:37.686437 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a4641943-0953-4276-9aff-ca6c465de8e9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:37.686863 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a4641943-0953-4276-9aff-ca6c465de8e9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:37.752792 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a4641943-0953-4276-9aff-ca6c465de8e9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:37.761205 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a4641943-0953-4276-9aff-ca6c465de8e9 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1242 microversion: 2.1 time: 0.089594 Aug 04 22:30:37.762010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 503/998] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:37 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:38.183333 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-dde660f5-f632-40c9-bc4e-e27f9f97d349 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:38.183949 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-dde660f5-f632-40c9-bc4e-e27f9f97d349 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:38.185860 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:38.186642 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=10 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:38.194290 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dde660f5-f632-40c9-bc4e-e27f9f97d349 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:38.194780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dde660f5-f632-40c9-bc4e-e27f9f97d349 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:38.195223 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dde660f5-f632-40c9-bc4e-e27f9f97d349 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:38.195922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dde660f5-f632-40c9-bc4e-e27f9f97d349 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:38.196379 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dde660f5-f632-40c9-bc4e-e27f9f97d349 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:38.196808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dde660f5-f632-40c9-bc4e-e27f9f97d349 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:38.337863 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-dde660f5-f632-40c9-bc4e-e27f9f97d349 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:38.345812 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-dde660f5-f632-40c9-bc4e-e27f9f97d349 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:38.347581 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-dde660f5-f632-40c9-bc4e-e27f9f97d349 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:38.349361 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-dde660f5-f632-40c9-bc4e-e27f9f97d349 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.169946 Aug 04 22:30:38.349946 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 496/999] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:38 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:38.782507 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-98e62462-f3f8-474c-9c0e-3dfa3e8e1722 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:38.783045 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-98e62462-f3f8-474c-9c0e-3dfa3e8e1722 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:38.790863 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98e62462-f3f8-474c-9c0e-3dfa3e8e1722 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:38.791355 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98e62462-f3f8-474c-9c0e-3dfa3e8e1722 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:38.791797 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98e62462-f3f8-474c-9c0e-3dfa3e8e1722 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:38.792535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98e62462-f3f8-474c-9c0e-3dfa3e8e1722 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:38.792997 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98e62462-f3f8-474c-9c0e-3dfa3e8e1722 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:38.793603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-98e62462-f3f8-474c-9c0e-3dfa3e8e1722 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:38.888871 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-98e62462-f3f8-474c-9c0e-3dfa3e8e1722 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:38.901526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-98e62462-f3f8-474c-9c0e-3dfa3e8e1722 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1298 microversion: 2.1 time: 0.122892 Aug 04 22:30:38.904105 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 504/1000] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:38 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1298 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:39.371981 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c1535c92-7b71-43b7-804b-ae832dfd98a2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:39.373174 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c1535c92-7b71-43b7-804b-ae832dfd98a2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:39.380066 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1535c92-7b71-43b7-804b-ae832dfd98a2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:39.380597 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1535c92-7b71-43b7-804b-ae832dfd98a2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:39.381232 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1535c92-7b71-43b7-804b-ae832dfd98a2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:39.381966 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1535c92-7b71-43b7-804b-ae832dfd98a2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:39.382417 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1535c92-7b71-43b7-804b-ae832dfd98a2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:39.382836 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c1535c92-7b71-43b7-804b-ae832dfd98a2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:39.589010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c1535c92-7b71-43b7-804b-ae832dfd98a2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:39.598958 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c1535c92-7b71-43b7-804b-ae832dfd98a2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:39.600754 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c1535c92-7b71-43b7-804b-ae832dfd98a2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:39.602130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c1535c92-7b71-43b7-804b-ae832dfd98a2 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.234012 Aug 04 22:30:39.602870 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 497/1001] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:39 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:39.924297 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-57b6a96a-8d4b-4b37-852a-6a189cc6b1ac tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:39.936309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-57b6a96a-8d4b-4b37-852a-6a189cc6b1ac tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:39.944198 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57b6a96a-8d4b-4b37-852a-6a189cc6b1ac tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:39.944834 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57b6a96a-8d4b-4b37-852a-6a189cc6b1ac tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:39.945346 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57b6a96a-8d4b-4b37-852a-6a189cc6b1ac tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:39.946277 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57b6a96a-8d4b-4b37-852a-6a189cc6b1ac tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:39.946991 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57b6a96a-8d4b-4b37-852a-6a189cc6b1ac tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:39.947673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-57b6a96a-8d4b-4b37-852a-6a189cc6b1ac tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:40.089890 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-57b6a96a-8d4b-4b37-852a-6a189cc6b1ac tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:40.098826 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-57b6a96a-8d4b-4b37-852a-6a189cc6b1ac tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1372 microversion: 2.1 time: 0.178457 Aug 04 22:30:40.099446 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 505/1002] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:39 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:40.625698 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ea03886f-3d5b-4f5f-80e7-b7dd0e1c57b9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:40.626389 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ea03886f-3d5b-4f5f-80e7-b7dd0e1c57b9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:40.630861 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:40.635251 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ea03886f-3d5b-4f5f-80e7-b7dd0e1c57b9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:40.635749 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ea03886f-3d5b-4f5f-80e7-b7dd0e1c57b9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:40.636196 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ea03886f-3d5b-4f5f-80e7-b7dd0e1c57b9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:40.636907 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ea03886f-3d5b-4f5f-80e7-b7dd0e1c57b9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:40.637368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ea03886f-3d5b-4f5f-80e7-b7dd0e1c57b9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:40.637828 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ea03886f-3d5b-4f5f-80e7-b7dd0e1c57b9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:40.845016 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ea03886f-3d5b-4f5f-80e7-b7dd0e1c57b9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:40.854679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ea03886f-3d5b-4f5f-80e7-b7dd0e1c57b9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:40.856192 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ea03886f-3d5b-4f5f-80e7-b7dd0e1c57b9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:40.857364 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ea03886f-3d5b-4f5f-80e7-b7dd0e1c57b9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.236673 Aug 04 22:30:40.868533 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 498/1003] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:40 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:40.938607 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-8136204d-95e9-40d2-b1ac-c6dc8944c55f req-d5555510-7c2e-4334-aa7f-17fa9c2c3892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc7a7f9-fcbe-425c-9f91-5e6714f008c0", "tag": "36b51b87-4d4b-46be-adab-47e6b1e54bfb"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:40.959577 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-8136204d-95e9-40d2-b1ac-c6dc8944c55f req-d5555510-7c2e-4334-aa7f-17fa9c2c3892 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:40.961805 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-8136204d-95e9-40d2-b1ac-c6dc8944c55f req-d5555510-7c2e-4334-aa7f-17fa9c2c3892 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:40.962325 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-8136204d-95e9-40d2-b1ac-c6dc8944c55f req-d5555510-7c2e-4334-aa7f-17fa9c2c3892 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:40.979848 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-8136204d-95e9-40d2-b1ac-c6dc8944c55f req-d5555510-7c2e-4334-aa7f-17fa9c2c3892 service nova] Creating event network-changed:36b51b87-4d4b-46be-adab-47e6b1e54bfb for instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 on hv-cinder-85221 Aug 04 22:30:40.985223 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-8136204d-95e9-40d2-b1ac-c6dc8944c55f req-d5555510-7c2e-4334-aa7f-17fa9c2c3892 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058580 Aug 04 22:30:40.985889 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 506/1004] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:30:41.122210 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-31271c7b-cc7b-4f2d-b4c9-e891dbc4c5af tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:41.122870 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-31271c7b-cc7b-4f2d-b4c9-e891dbc4c5af tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:41.129143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-31271c7b-cc7b-4f2d-b4c9-e891dbc4c5af tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:41.130286 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-31271c7b-cc7b-4f2d-b4c9-e891dbc4c5af tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:41.130729 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-31271c7b-cc7b-4f2d-b4c9-e891dbc4c5af tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:41.131450 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-31271c7b-cc7b-4f2d-b4c9-e891dbc4c5af tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:41.131943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-31271c7b-cc7b-4f2d-b4c9-e891dbc4c5af tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:41.132371 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-31271c7b-cc7b-4f2d-b4c9-e891dbc4c5af tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:41.366234 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-31271c7b-cc7b-4f2d-b4c9-e891dbc4c5af tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:41.373782 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-31271c7b-cc7b-4f2d-b4c9-e891dbc4c5af tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1372 microversion: 2.1 time: 0.257272 Aug 04 22:30:41.374357 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 499/1005] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:41 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:41.882184 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a317543a-fb92-4d48-998a-70897458c13b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:41.882882 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a317543a-fb92-4d48-998a-70897458c13b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:41.889051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a317543a-fb92-4d48-998a-70897458c13b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:41.889579 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a317543a-fb92-4d48-998a-70897458c13b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:41.890025 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a317543a-fb92-4d48-998a-70897458c13b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:41.890723 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a317543a-fb92-4d48-998a-70897458c13b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:41.891177 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a317543a-fb92-4d48-998a-70897458c13b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:41.891607 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a317543a-fb92-4d48-998a-70897458c13b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:42.040369 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a317543a-fb92-4d48-998a-70897458c13b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:42.048592 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a317543a-fb92-4d48-998a-70897458c13b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:42.050115 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a317543a-fb92-4d48-998a-70897458c13b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:42.051946 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a317543a-fb92-4d48-998a-70897458c13b tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.174613 Aug 04 22:30:42.052494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 507/1006] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:41 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:42.394830 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6d4acbb5-c43a-451c-9e33-d49266dbf187 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:42.395461 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6d4acbb5-c43a-451c-9e33-d49266dbf187 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:42.402640 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6d4acbb5-c43a-451c-9e33-d49266dbf187 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:42.403158 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6d4acbb5-c43a-451c-9e33-d49266dbf187 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:42.403603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6d4acbb5-c43a-451c-9e33-d49266dbf187 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:42.404455 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6d4acbb5-c43a-451c-9e33-d49266dbf187 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:42.404963 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6d4acbb5-c43a-451c-9e33-d49266dbf187 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:42.405398 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6d4acbb5-c43a-451c-9e33-d49266dbf187 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:42.478611 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-2e0176f6-48f2-414b-8ac3-4dd3457d97db tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:42.479111 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-2e0176f6-48f2-414b-8ac3-4dd3457d97db tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:42.484978 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2e0176f6-48f2-414b-8ac3-4dd3457d97db tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:42.485500 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2e0176f6-48f2-414b-8ac3-4dd3457d97db tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:42.485948 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2e0176f6-48f2-414b-8ac3-4dd3457d97db tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:42.486647 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2e0176f6-48f2-414b-8ac3-4dd3457d97db tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:42.487104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2e0176f6-48f2-414b-8ac3-4dd3457d97db tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:42.487535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2e0176f6-48f2-414b-8ac3-4dd3457d97db tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:42.510596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-2e0176f6-48f2-414b-8ac3-4dd3457d97db tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/ips" status: 200 len: 146 microversion: 2.1 time: 0.035895 Aug 04 22:30:42.511172 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 508/1007] 10.222.0.109 () {58 vars in 1253 bytes} [Thu Aug 4 22:30:42 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:30:42.542577 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6d4acbb5-c43a-451c-9e33-d49266dbf187 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:42.550092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6d4acbb5-c43a-451c-9e33-d49266dbf187 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1372 microversion: 2.1 time: 0.159270 Aug 04 22:30:42.550664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 500/1008] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:42 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:42.915935 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-a012d825-6745-4346-98a6-003ba2934c7e req-59237e41-9ee3-48f7-920c-8a91f26eb893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e61c4e-2c74-44c2-90bd-f997db2fbd0a", "name": "network-vif-plugged", "status": "completed", "tag": "9bb4a82b-caa1-4ea9-a34f-05e170ce6471"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:42.920746 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:42.927409 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a012d825-6745-4346-98a6-003ba2934c7e req-59237e41-9ee3-48f7-920c-8a91f26eb893 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:42.927966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a012d825-6745-4346-98a6-003ba2934c7e req-59237e41-9ee3-48f7-920c-8a91f26eb893 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:42.928409 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-a012d825-6745-4346-98a6-003ba2934c7e req-59237e41-9ee3-48f7-920c-8a91f26eb893 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:42.940406 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-a012d825-6745-4346-98a6-003ba2934c7e req-59237e41-9ee3-48f7-920c-8a91f26eb893 service nova] Creating event network-vif-plugged:9bb4a82b-caa1-4ea9-a34f-05e170ce6471 for instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a on hv-cinder-85221 Aug 04 22:30:42.946561 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-a012d825-6745-4346-98a6-003ba2934c7e req-59237e41-9ee3-48f7-920c-8a91f26eb893 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034316 Aug 04 22:30:42.947351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 509/1009] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:30:43.075522 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a465509e-5345-4142-97d1-ed6be60a392f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:43.076128 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a465509e-5345-4142-97d1-ed6be60a392f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:43.083806 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a465509e-5345-4142-97d1-ed6be60a392f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:43.084292 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a465509e-5345-4142-97d1-ed6be60a392f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:43.084733 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a465509e-5345-4142-97d1-ed6be60a392f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:43.085487 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a465509e-5345-4142-97d1-ed6be60a392f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:43.085945 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a465509e-5345-4142-97d1-ed6be60a392f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:43.086368 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a465509e-5345-4142-97d1-ed6be60a392f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:43.214966 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a465509e-5345-4142-97d1-ed6be60a392f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:43.223799 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a465509e-5345-4142-97d1-ed6be60a392f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:43.225308 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a465509e-5345-4142-97d1-ed6be60a392f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:43.226494 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a465509e-5345-4142-97d1-ed6be60a392f tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.155140 Aug 04 22:30:43.227051 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 501/1010] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:43 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:43.571505 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-29c6ea6a-3002-43db-88d9-ce58ccbf39ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:43.572211 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-29c6ea6a-3002-43db-88d9-ce58ccbf39ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:43.578470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-29c6ea6a-3002-43db-88d9-ce58ccbf39ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:43.578957 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-29c6ea6a-3002-43db-88d9-ce58ccbf39ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:43.579457 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-29c6ea6a-3002-43db-88d9-ce58ccbf39ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:43.580154 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-29c6ea6a-3002-43db-88d9-ce58ccbf39ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:43.580614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-29c6ea6a-3002-43db-88d9-ce58ccbf39ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:43.581043 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-29c6ea6a-3002-43db-88d9-ce58ccbf39ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:43.600832 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=100 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:43.713564 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-29c6ea6a-3002-43db-88d9-ce58ccbf39ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:43.720979 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-29c6ea6a-3002-43db-88d9-ce58ccbf39ae tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1372 microversion: 2.1 time: 0.154747 Aug 04 22:30:43.721579 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 510/1011] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:43 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:44.249423 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d812a16b-ccc5-4125-b603-0d6c6b685649 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:44.250061 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d812a16b-ccc5-4125-b603-0d6c6b685649 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:44.256621 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d812a16b-ccc5-4125-b603-0d6c6b685649 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:44.257108 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d812a16b-ccc5-4125-b603-0d6c6b685649 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:44.257577 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d812a16b-ccc5-4125-b603-0d6c6b685649 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:44.258278 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d812a16b-ccc5-4125-b603-0d6c6b685649 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:44.258739 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d812a16b-ccc5-4125-b603-0d6c6b685649 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:44.259175 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d812a16b-ccc5-4125-b603-0d6c6b685649 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:44.263048 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=100 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:44.386941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d812a16b-ccc5-4125-b603-0d6c6b685649 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:44.395394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d812a16b-ccc5-4125-b603-0d6c6b685649 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:44.396903 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d812a16b-ccc5-4125-b603-0d6c6b685649 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:44.398092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d812a16b-ccc5-4125-b603-0d6c6b685649 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.152590 Aug 04 22:30:44.398649 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 502/1012] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:44 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:44.742971 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-07efb386-eb9d-4268-b5cc-43b73fcca1ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:44.743591 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-07efb386-eb9d-4268-b5cc-43b73fcca1ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:44.750102 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-07efb386-eb9d-4268-b5cc-43b73fcca1ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:44.750590 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-07efb386-eb9d-4268-b5cc-43b73fcca1ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:44.751030 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-07efb386-eb9d-4268-b5cc-43b73fcca1ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:44.751721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-07efb386-eb9d-4268-b5cc-43b73fcca1ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:44.752178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-07efb386-eb9d-4268-b5cc-43b73fcca1ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:44.752606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-07efb386-eb9d-4268-b5cc-43b73fcca1ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:44.896432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-07efb386-eb9d-4268-b5cc-43b73fcca1ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:44.903829 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-07efb386-eb9d-4268-b5cc-43b73fcca1ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1372 microversion: 2.1 time: 0.165406 Aug 04 22:30:44.904394 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 511/1013] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:44 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:45.051900 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4debe088-69c2-478e-9d77-72bbb51878dc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eeb987e7-75c6-4bbb-af38-7e685084bd17"}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:45.054348 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4debe088-69c2-478e-9d77-72bbb51878dc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:45.060579 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4debe088-69c2-478e-9d77-72bbb51878dc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:45.061068 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4debe088-69c2-478e-9d77-72bbb51878dc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:45.061535 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4debe088-69c2-478e-9d77-72bbb51878dc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:45.062256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4debe088-69c2-478e-9d77-72bbb51878dc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:45.062722 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4debe088-69c2-478e-9d77-72bbb51878dc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:45.063147 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4debe088-69c2-478e-9d77-72bbb51878dc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:45.326857 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4debe088-69c2-478e-9d77-72bbb51878dc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "POST /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278746 Aug 04 22:30:45.327852 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 503/1014] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:30:45 2022] POST /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:30:45.420193 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-17dbacf2-dfec-4971-8344-a82bb7d9f2bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:45.420808 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-17dbacf2-dfec-4971-8344-a82bb7d9f2bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:45.427431 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-17dbacf2-dfec-4971-8344-a82bb7d9f2bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:45.427940 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-17dbacf2-dfec-4971-8344-a82bb7d9f2bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:45.428376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-17dbacf2-dfec-4971-8344-a82bb7d9f2bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:45.429073 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-17dbacf2-dfec-4971-8344-a82bb7d9f2bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:45.429549 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-17dbacf2-dfec-4971-8344-a82bb7d9f2bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:45.429976 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-17dbacf2-dfec-4971-8344-a82bb7d9f2bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:45.562752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-17dbacf2-dfec-4971-8344-a82bb7d9f2bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:45.572391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-17dbacf2-dfec-4971-8344-a82bb7d9f2bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:45.574183 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-17dbacf2-dfec-4971-8344-a82bb7d9f2bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:45.575602 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-17dbacf2-dfec-4971-8344-a82bb7d9f2bf tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.159524 Aug 04 22:30:45.576443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 512/1015] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:45 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:45.926455 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1a78836f-5f07-44af-b134-23b5194c44b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:45.927170 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1a78836f-5f07-44af-b134-23b5194c44b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:45.933942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1a78836f-5f07-44af-b134-23b5194c44b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:45.934424 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1a78836f-5f07-44af-b134-23b5194c44b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:45.934856 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1a78836f-5f07-44af-b134-23b5194c44b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:45.935535 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1a78836f-5f07-44af-b134-23b5194c44b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:45.935985 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1a78836f-5f07-44af-b134-23b5194c44b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:45.936404 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1a78836f-5f07-44af-b134-23b5194c44b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:46.073905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1a78836f-5f07-44af-b134-23b5194c44b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:46.081435 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1a78836f-5f07-44af-b134-23b5194c44b1 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1372 microversion: 2.1 time: 0.160050 Aug 04 22:30:46.082503 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 504/1016] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:45 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:46.603249 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-97c1b462-6bbe-4ba0-a838-a16cbdb512d3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:46.603854 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-97c1b462-6bbe-4ba0-a838-a16cbdb512d3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:46.610907 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-97c1b462-6bbe-4ba0-a838-a16cbdb512d3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:46.611422 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-97c1b462-6bbe-4ba0-a838-a16cbdb512d3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:46.611858 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-97c1b462-6bbe-4ba0-a838-a16cbdb512d3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:46.612557 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-97c1b462-6bbe-4ba0-a838-a16cbdb512d3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:46.613590 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-97c1b462-6bbe-4ba0-a838-a16cbdb512d3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:46.614154 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-97c1b462-6bbe-4ba0-a838-a16cbdb512d3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:46.752541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-97c1b462-6bbe-4ba0-a838-a16cbdb512d3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:46.760662 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-97c1b462-6bbe-4ba0-a838-a16cbdb512d3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:46.762215 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-97c1b462-6bbe-4ba0-a838-a16cbdb512d3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:46.763366 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-97c1b462-6bbe-4ba0-a838-a16cbdb512d3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1737 microversion: 2.20 time: 0.163996 Aug 04 22:30:46.763923 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 513/1017] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:46 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:46.962965 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-071c558b-8518-4c24-b672-703a89964eda req-b899db39-91ce-4d61-93ce-a614ec218589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc7a7f9-fcbe-425c-9f91-5e6714f008c0", "name": "network-vif-plugged", "status": "completed", "tag": "36b51b87-4d4b-46be-adab-47e6b1e54bfb"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:46.975900 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-071c558b-8518-4c24-b672-703a89964eda req-b899db39-91ce-4d61-93ce-a614ec218589 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:46.976393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-071c558b-8518-4c24-b672-703a89964eda req-b899db39-91ce-4d61-93ce-a614ec218589 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:46.976833 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-071c558b-8518-4c24-b672-703a89964eda req-b899db39-91ce-4d61-93ce-a614ec218589 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:46.987735 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-071c558b-8518-4c24-b672-703a89964eda req-b899db39-91ce-4d61-93ce-a614ec218589 service nova] Creating event network-vif-plugged:36b51b87-4d4b-46be-adab-47e6b1e54bfb for instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 on hv-cinder-85221 Aug 04 22:30:46.993283 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-071c558b-8518-4c24-b672-703a89964eda req-b899db39-91ce-4d61-93ce-a614ec218589 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034553 Aug 04 22:30:46.994307 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 505/1018] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:30:47.102781 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-cac22039-95a8-4a6e-a87b-f001c3f8c6ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:47.103504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-cac22039-95a8-4a6e-a87b-f001c3f8c6ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:47.109651 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cac22039-95a8-4a6e-a87b-f001c3f8c6ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:47.110367 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cac22039-95a8-4a6e-a87b-f001c3f8c6ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:47.110883 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cac22039-95a8-4a6e-a87b-f001c3f8c6ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:47.111652 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cac22039-95a8-4a6e-a87b-f001c3f8c6ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:47.112176 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cac22039-95a8-4a6e-a87b-f001c3f8c6ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:47.113171 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cac22039-95a8-4a6e-a87b-f001c3f8c6ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:47.246151 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-cac22039-95a8-4a6e-a87b-f001c3f8c6ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:47.253627 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-cac22039-95a8-4a6e-a87b-f001c3f8c6ed tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1372 microversion: 2.1 time: 0.154825 Aug 04 22:30:47.254409 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 514/1019] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:47 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:47.786844 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-67167e96-559f-48e7-b145-9dbad8ba636e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:47.787513 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-67167e96-559f-48e7-b145-9dbad8ba636e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:47.794178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-67167e96-559f-48e7-b145-9dbad8ba636e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:47.794665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-67167e96-559f-48e7-b145-9dbad8ba636e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:47.795103 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-67167e96-559f-48e7-b145-9dbad8ba636e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:47.795822 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-67167e96-559f-48e7-b145-9dbad8ba636e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:47.796276 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-67167e96-559f-48e7-b145-9dbad8ba636e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:47.797049 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-67167e96-559f-48e7-b145-9dbad8ba636e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:47.933790 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-67167e96-559f-48e7-b145-9dbad8ba636e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:47.941823 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-67167e96-559f-48e7-b145-9dbad8ba636e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:47.943325 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-67167e96-559f-48e7-b145-9dbad8ba636e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:47.944563 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-67167e96-559f-48e7-b145-9dbad8ba636e tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1724 microversion: 2.20 time: 0.162223 Aug 04 22:30:47.945206 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 506/1020] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:30:47 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:30:48.274184 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-75685a66-fef7-4432-a49e-7b7068dc5c4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:48.274937 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-75685a66-fef7-4432-a49e-7b7068dc5c4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:48.281543 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-75685a66-fef7-4432-a49e-7b7068dc5c4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:48.282035 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-75685a66-fef7-4432-a49e-7b7068dc5c4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:48.282479 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-75685a66-fef7-4432-a49e-7b7068dc5c4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:48.283208 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-75685a66-fef7-4432-a49e-7b7068dc5c4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:48.283667 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-75685a66-fef7-4432-a49e-7b7068dc5c4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:48.284097 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-75685a66-fef7-4432-a49e-7b7068dc5c4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:48.411294 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-75685a66-fef7-4432-a49e-7b7068dc5c4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:48.418767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-75685a66-fef7-4432-a49e-7b7068dc5c4a tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1372 microversion: 2.1 time: 0.149440 Aug 04 22:30:48.419335 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 515/1021] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:48 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:49.439576 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4b5fd891-0080-4685-913a-77a80100d75c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:49.440190 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4b5fd891-0080-4685-913a-77a80100d75c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:49.447418 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5fd891-0080-4685-913a-77a80100d75c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:49.447896 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5fd891-0080-4685-913a-77a80100d75c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:49.448326 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5fd891-0080-4685-913a-77a80100d75c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:49.449027 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5fd891-0080-4685-913a-77a80100d75c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:49.449536 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5fd891-0080-4685-913a-77a80100d75c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:49.449955 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5fd891-0080-4685-913a-77a80100d75c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:49.579909 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4b5fd891-0080-4685-913a-77a80100d75c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:49.587772 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4b5fd891-0080-4685-913a-77a80100d75c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1562 microversion: 2.1 time: 0.152083 Aug 04 22:30:49.588344 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 507/1022] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:49 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:49.608854 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-03aeed95-20a7-42fe-afed-7055fcd204a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:49.609357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-03aeed95-20a7-42fe-afed-7055fcd204a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:49.616978 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03aeed95-20a7-42fe-afed-7055fcd204a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:49.617528 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03aeed95-20a7-42fe-afed-7055fcd204a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:49.617972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03aeed95-20a7-42fe-afed-7055fcd204a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:49.618672 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03aeed95-20a7-42fe-afed-7055fcd204a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:49.619126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03aeed95-20a7-42fe-afed-7055fcd204a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:49.619574 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03aeed95-20a7-42fe-afed-7055fcd204a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:49.701564 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-03aeed95-20a7-42fe-afed-7055fcd204a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096625 Aug 04 22:30:49.702169 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 516/1023] 10.222.0.109 () {58 vars in 1280 bytes} [Thu Aug 4 22:30:49 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:30:50.625677 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-51c15196-71c4-4def-8752-67cac7e77141 req-839f3542-6728-4bbb-a7a9-2f887aba1ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc7a7f9-fcbe-425c-9f91-5e6714f008c0", "tag": "36b51b87-4d4b-46be-adab-47e6b1e54bfb"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:50.635968 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-51c15196-71c4-4def-8752-67cac7e77141 req-839f3542-6728-4bbb-a7a9-2f887aba1ae1 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:50.636342 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-51c15196-71c4-4def-8752-67cac7e77141 req-839f3542-6728-4bbb-a7a9-2f887aba1ae1 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:50.637190 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-51c15196-71c4-4def-8752-67cac7e77141 req-839f3542-6728-4bbb-a7a9-2f887aba1ae1 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:50.651336 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-51c15196-71c4-4def-8752-67cac7e77141 req-839f3542-6728-4bbb-a7a9-2f887aba1ae1 service nova] Creating event network-changed:36b51b87-4d4b-46be-adab-47e6b1e54bfb for instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 on hv-cinder-85221 Aug 04 22:30:50.658110 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-51c15196-71c4-4def-8752-67cac7e77141 req-839f3542-6728-4bbb-a7a9-2f887aba1ae1 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035918 Aug 04 22:30:50.661942 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 508/1024] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:30:52.870218 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-dd1b8a28-babd-4022-93c2-54ba6b2e48e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:30:52.876134 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dd1b8a28-babd-4022-93c2-54ba6b2e48e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:52.876609 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dd1b8a28-babd-4022-93c2-54ba6b2e48e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:52.877038 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dd1b8a28-babd-4022-93c2-54ba6b2e48e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:52.936631 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-dd1b8a28-babd-4022-93c2-54ba6b2e48e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Going to try to stop instance {{(pid=129196) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 22:30:52.982715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-dd1b8a28-babd-4022-93c2-54ba6b2e48e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "POST /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/action" status: 202 len: 0 microversion: 2.1 time: 0.116648 Aug 04 22:30:52.983344 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 517/1025] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:30:52 2022] POST /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:30:52.993125 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-69dc4ff2-f897-4368-ad07-a3cd1ec0abb3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:52.993864 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-69dc4ff2-f897-4368-ad07-a3cd1ec0abb3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:53.000007 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-69dc4ff2-f897-4368-ad07-a3cd1ec0abb3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:53.000495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-69dc4ff2-f897-4368-ad07-a3cd1ec0abb3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:53.000932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-69dc4ff2-f897-4368-ad07-a3cd1ec0abb3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:53.001676 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-69dc4ff2-f897-4368-ad07-a3cd1ec0abb3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:53.002138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-69dc4ff2-f897-4368-ad07-a3cd1ec0abb3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:53.002564 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-69dc4ff2-f897-4368-ad07-a3cd1ec0abb3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:53.139947 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-69dc4ff2-f897-4368-ad07-a3cd1ec0abb3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:53.148327 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-69dc4ff2-f897-4368-ad07-a3cd1ec0abb3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.160597 Aug 04 22:30:53.148887 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 509/1026] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:52 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:54.171366 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-25c0ef7f-ce4e-4b8c-bd0b-91bf4195309c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:54.172070 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-25c0ef7f-ce4e-4b8c-bd0b-91bf4195309c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:54.178853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25c0ef7f-ce4e-4b8c-bd0b-91bf4195309c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:54.179372 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25c0ef7f-ce4e-4b8c-bd0b-91bf4195309c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:54.179811 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25c0ef7f-ce4e-4b8c-bd0b-91bf4195309c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:54.180506 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25c0ef7f-ce4e-4b8c-bd0b-91bf4195309c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:54.180964 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25c0ef7f-ce4e-4b8c-bd0b-91bf4195309c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:54.181420 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-25c0ef7f-ce4e-4b8c-bd0b-91bf4195309c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:54.313956 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-25c0ef7f-ce4e-4b8c-bd0b-91bf4195309c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:54.322045 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-25c0ef7f-ce4e-4b8c-bd0b-91bf4195309c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.155569 Aug 04 22:30:54.322605 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 518/1027] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:54 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:55.342313 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9be31564-4b62-44ed-8347-05f54c44586d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:55.342923 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-9be31564-4b62-44ed-8347-05f54c44586d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:55.350104 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9be31564-4b62-44ed-8347-05f54c44586d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:55.350587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9be31564-4b62-44ed-8347-05f54c44586d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:55.351028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9be31564-4b62-44ed-8347-05f54c44586d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:55.351718 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9be31564-4b62-44ed-8347-05f54c44586d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:55.352174 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9be31564-4b62-44ed-8347-05f54c44586d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:55.352596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9be31564-4b62-44ed-8347-05f54c44586d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:55.482753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9be31564-4b62-44ed-8347-05f54c44586d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:55.491188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9be31564-4b62-44ed-8347-05f54c44586d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.152782 Aug 04 22:30:55.491753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 510/1028] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:55 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:56.511959 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-71cc2c70-426e-41e9-a0ed-a11472ccffdc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:56.512568 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-71cc2c70-426e-41e9-a0ed-a11472ccffdc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:56.519095 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-71cc2c70-426e-41e9-a0ed-a11472ccffdc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:56.519574 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-71cc2c70-426e-41e9-a0ed-a11472ccffdc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:56.520716 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-71cc2c70-426e-41e9-a0ed-a11472ccffdc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:56.521425 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-71cc2c70-426e-41e9-a0ed-a11472ccffdc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:56.521897 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-71cc2c70-426e-41e9-a0ed-a11472ccffdc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:56.522296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-71cc2c70-426e-41e9-a0ed-a11472ccffdc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:56.655097 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-71cc2c70-426e-41e9-a0ed-a11472ccffdc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:56.663408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-71cc2c70-426e-41e9-a0ed-a11472ccffdc tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.155268 Aug 04 22:30:56.663982 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 519/1029] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:56 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:57.684804 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ab7694fc-ae25-4735-83ee-96b648de3973 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:57.685441 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ab7694fc-ae25-4735-83ee-96b648de3973 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:57.691894 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ab7694fc-ae25-4735-83ee-96b648de3973 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:57.692420 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ab7694fc-ae25-4735-83ee-96b648de3973 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:57.692860 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ab7694fc-ae25-4735-83ee-96b648de3973 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:57.693596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ab7694fc-ae25-4735-83ee-96b648de3973 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:57.694057 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ab7694fc-ae25-4735-83ee-96b648de3973 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:57.694488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ab7694fc-ae25-4735-83ee-96b648de3973 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:57.832178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ab7694fc-ae25-4735-83ee-96b648de3973 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:57.841372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ab7694fc-ae25-4735-83ee-96b648de3973 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.160433 Aug 04 22:30:57.841967 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 511/1030] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:57 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:30:58.862162 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-73ac518b-9d70-47cd-ae4c-0e31c7b2d9e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:30:58.862813 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-73ac518b-9d70-47cd-ae4c-0e31c7b2d9e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:30:58.869870 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73ac518b-9d70-47cd-ae4c-0e31c7b2d9e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:58.870359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73ac518b-9d70-47cd-ae4c-0e31c7b2d9e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:58.870799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73ac518b-9d70-47cd-ae4c-0e31c7b2d9e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:58.871497 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73ac518b-9d70-47cd-ae4c-0e31c7b2d9e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:30:58.871958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73ac518b-9d70-47cd-ae4c-0e31c7b2d9e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:30:58.872387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73ac518b-9d70-47cd-ae4c-0e31c7b2d9e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:30:59.005613 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-73ac518b-9d70-47cd-ae4c-0e31c7b2d9e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:30:59.013628 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-73ac518b-9d70-47cd-ae4c-0e31c7b2d9e0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.155296 Aug 04 22:30:59.014204 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 520/1031] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:30:58 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:00.036844 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1cfa6f49-78e7-4e2f-b44d-8f9230d60cd7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:00.037499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1cfa6f49-78e7-4e2f-b44d-8f9230d60cd7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:00.044064 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1cfa6f49-78e7-4e2f-b44d-8f9230d60cd7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:00.044550 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1cfa6f49-78e7-4e2f-b44d-8f9230d60cd7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:00.044995 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1cfa6f49-78e7-4e2f-b44d-8f9230d60cd7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:00.045738 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1cfa6f49-78e7-4e2f-b44d-8f9230d60cd7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:00.046198 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1cfa6f49-78e7-4e2f-b44d-8f9230d60cd7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:00.046626 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1cfa6f49-78e7-4e2f-b44d-8f9230d60cd7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:00.179495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1cfa6f49-78e7-4e2f-b44d-8f9230d60cd7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:00.187451 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1cfa6f49-78e7-4e2f-b44d-8f9230d60cd7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.155229 Aug 04 22:31:00.188020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 512/1032] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:00 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:01.209049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6235c4c0-7dc6-4f32-81a2-19e7adda002b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:01.209681 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6235c4c0-7dc6-4f32-81a2-19e7adda002b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:01.215680 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6235c4c0-7dc6-4f32-81a2-19e7adda002b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:01.216160 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6235c4c0-7dc6-4f32-81a2-19e7adda002b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:01.216596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6235c4c0-7dc6-4f32-81a2-19e7adda002b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:01.217283 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6235c4c0-7dc6-4f32-81a2-19e7adda002b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:01.217772 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6235c4c0-7dc6-4f32-81a2-19e7adda002b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:01.218223 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6235c4c0-7dc6-4f32-81a2-19e7adda002b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:01.349945 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6235c4c0-7dc6-4f32-81a2-19e7adda002b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:01.357769 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6235c4c0-7dc6-4f32-81a2-19e7adda002b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.153350 Aug 04 22:31:01.358331 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 521/1033] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:01 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:02.379162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d898a5ec-6ead-4c6c-829b-e19353ad6534 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:02.379775 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d898a5ec-6ead-4c6c-829b-e19353ad6534 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:02.386122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d898a5ec-6ead-4c6c-829b-e19353ad6534 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:02.386604 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d898a5ec-6ead-4c6c-829b-e19353ad6534 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:02.387033 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d898a5ec-6ead-4c6c-829b-e19353ad6534 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:02.387714 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d898a5ec-6ead-4c6c-829b-e19353ad6534 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:02.388163 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d898a5ec-6ead-4c6c-829b-e19353ad6534 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:02.388581 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d898a5ec-6ead-4c6c-829b-e19353ad6534 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:02.517960 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d898a5ec-6ead-4c6c-829b-e19353ad6534 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:02.526600 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d898a5ec-6ead-4c6c-829b-e19353ad6534 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.151791 Aug 04 22:31:02.527164 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 513/1034] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:02 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:03.547795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4eb4e5f8-edf1-4357-b35e-a796ddf8bd6c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:03.548509 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4eb4e5f8-edf1-4357-b35e-a796ddf8bd6c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:03.554873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4eb4e5f8-edf1-4357-b35e-a796ddf8bd6c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:03.555351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4eb4e5f8-edf1-4357-b35e-a796ddf8bd6c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:03.555780 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4eb4e5f8-edf1-4357-b35e-a796ddf8bd6c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:03.556464 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4eb4e5f8-edf1-4357-b35e-a796ddf8bd6c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:03.556914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4eb4e5f8-edf1-4357-b35e-a796ddf8bd6c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:03.557335 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4eb4e5f8-edf1-4357-b35e-a796ddf8bd6c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:03.685738 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4eb4e5f8-edf1-4357-b35e-a796ddf8bd6c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:03.694013 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4eb4e5f8-edf1-4357-b35e-a796ddf8bd6c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.150187 Aug 04 22:31:03.694578 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 522/1035] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:03 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:31:04.716184 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-42ca9511-babb-4970-ab3c-0d4891bfc19f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:04.716799 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-42ca9511-babb-4970-ab3c-0d4891bfc19f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:04.723475 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-42ca9511-babb-4970-ab3c-0d4891bfc19f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:04.724067 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-42ca9511-babb-4970-ab3c-0d4891bfc19f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:04.724509 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-42ca9511-babb-4970-ab3c-0d4891bfc19f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:04.725204 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-42ca9511-babb-4970-ab3c-0d4891bfc19f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:04.725695 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-42ca9511-babb-4970-ab3c-0d4891bfc19f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:04.726125 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-42ca9511-babb-4970-ab3c-0d4891bfc19f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:04.859430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-42ca9511-babb-4970-ab3c-0d4891bfc19f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:04.867814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-42ca9511-babb-4970-ab3c-0d4891bfc19f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.155497 Aug 04 22:31:04.868379 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 514/1036] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:04 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:05.889214 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7b88cd32-0d9d-4b67-8805-e189806f1f12 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:05.889893 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7b88cd32-0d9d-4b67-8805-e189806f1f12 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:05.896898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7b88cd32-0d9d-4b67-8805-e189806f1f12 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:05.897379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7b88cd32-0d9d-4b67-8805-e189806f1f12 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:05.897837 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7b88cd32-0d9d-4b67-8805-e189806f1f12 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:05.898534 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7b88cd32-0d9d-4b67-8805-e189806f1f12 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:05.898989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7b88cd32-0d9d-4b67-8805-e189806f1f12 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:05.899413 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7b88cd32-0d9d-4b67-8805-e189806f1f12 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:06.032364 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7b88cd32-0d9d-4b67-8805-e189806f1f12 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:06.040956 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7b88cd32-0d9d-4b67-8805-e189806f1f12 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.155581 Aug 04 22:31:06.041551 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 523/1037] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:05 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:07.061200 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-993043b5-c3d4-4a4c-b534-ac95ae93b39b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:07.061857 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-993043b5-c3d4-4a4c-b534-ac95ae93b39b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:07.068886 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-993043b5-c3d4-4a4c-b534-ac95ae93b39b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:07.069375 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-993043b5-c3d4-4a4c-b534-ac95ae93b39b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:07.069840 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-993043b5-c3d4-4a4c-b534-ac95ae93b39b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:07.070537 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-993043b5-c3d4-4a4c-b534-ac95ae93b39b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:07.070996 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-993043b5-c3d4-4a4c-b534-ac95ae93b39b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:07.071427 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-993043b5-c3d4-4a4c-b534-ac95ae93b39b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:07.199334 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-993043b5-c3d4-4a4c-b534-ac95ae93b39b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:07.207238 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-993043b5-c3d4-4a4c-b534-ac95ae93b39b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.149940 Aug 04 22:31:07.207837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 515/1038] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:07 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:08.228656 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-dfb864d2-5bff-4530-8dd0-5e4f3697662e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:08.229304 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-dfb864d2-5bff-4530-8dd0-5e4f3697662e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:08.235829 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dfb864d2-5bff-4530-8dd0-5e4f3697662e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:08.236317 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dfb864d2-5bff-4530-8dd0-5e4f3697662e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:08.236759 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dfb864d2-5bff-4530-8dd0-5e4f3697662e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:08.237493 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dfb864d2-5bff-4530-8dd0-5e4f3697662e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:08.237955 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dfb864d2-5bff-4530-8dd0-5e4f3697662e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:08.238385 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dfb864d2-5bff-4530-8dd0-5e4f3697662e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:08.365759 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-dfb864d2-5bff-4530-8dd0-5e4f3697662e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:08.373699 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-dfb864d2-5bff-4530-8dd0-5e4f3697662e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.148998 Aug 04 22:31:08.374269 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 524/1039] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:08 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:09.395321 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4106e511-66da-431f-b384-c93db8e1263d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:09.396026 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4106e511-66da-431f-b384-c93db8e1263d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:09.402428 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4106e511-66da-431f-b384-c93db8e1263d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:09.402916 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4106e511-66da-431f-b384-c93db8e1263d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:09.403356 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4106e511-66da-431f-b384-c93db8e1263d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:09.404051 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4106e511-66da-431f-b384-c93db8e1263d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:09.404510 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4106e511-66da-431f-b384-c93db8e1263d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:09.404938 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4106e511-66da-431f-b384-c93db8e1263d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:09.534420 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4106e511-66da-431f-b384-c93db8e1263d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:09.542616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4106e511-66da-431f-b384-c93db8e1263d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.151140 Aug 04 22:31:09.543196 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 516/1040] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:09 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:10.386074 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-02151c05-3cce-4d59-bca2-49ad93a2fb56 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:31:10.386608 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-02151c05-3cce-4d59-bca2-49ad93a2fb56 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:10.393129 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02151c05-3cce-4d59-bca2-49ad93a2fb56 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:10.393657 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02151c05-3cce-4d59-bca2-49ad93a2fb56 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:10.394089 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02151c05-3cce-4d59-bca2-49ad93a2fb56 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:10.394768 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02151c05-3cce-4d59-bca2-49ad93a2fb56 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:10.395232 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02151c05-3cce-4d59-bca2-49ad93a2fb56 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:10.395738 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-02151c05-3cce-4d59-bca2-49ad93a2fb56 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:10.417901 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-02151c05-3cce-4d59-bca2-49ad93a2fb56 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lazy-loading 'flavor' on Instance uuid fd73ce87-41fe-4b81-9b4b-546962f70b2d {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:31:10.444214 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:31:10.491410 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-02151c05-3cce-4d59-bca2-49ad93a2fb56 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "POST /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d/action" status: 202 len: 0 microversion: 2.1 time: 0.108942 Aug 04 22:31:10.492054 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 525/1041] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:31:10 2022] POST /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:31:10.500096 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-880ef578-8b22-47c1-b8a9-2a45e78317c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:10.500709 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-880ef578-8b22-47c1-b8a9-2a45e78317c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:10.507938 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-880ef578-8b22-47c1-b8a9-2a45e78317c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:10.508452 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-880ef578-8b22-47c1-b8a9-2a45e78317c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:10.508886 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-880ef578-8b22-47c1-b8a9-2a45e78317c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:10.509613 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-880ef578-8b22-47c1-b8a9-2a45e78317c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:10.510071 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-880ef578-8b22-47c1-b8a9-2a45e78317c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:10.510494 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-880ef578-8b22-47c1-b8a9-2a45e78317c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:10.564349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c91f9cec-d402-4c7f-b859-ee5d4f402088 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:10.565047 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c91f9cec-d402-4c7f-b859-ee5d4f402088 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:10.572485 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c91f9cec-d402-4c7f-b859-ee5d4f402088 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:10.572973 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c91f9cec-d402-4c7f-b859-ee5d4f402088 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:10.573428 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c91f9cec-d402-4c7f-b859-ee5d4f402088 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:10.574128 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c91f9cec-d402-4c7f-b859-ee5d4f402088 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:10.574582 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c91f9cec-d402-4c7f-b859-ee5d4f402088 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:10.575935 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c91f9cec-d402-4c7f-b859-ee5d4f402088 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:10.650372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-880ef578-8b22-47c1-b8a9-2a45e78317c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:10.658029 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-880ef578-8b22-47c1-b8a9-2a45e78317c6 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.161672 Aug 04 22:31:10.658600 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 517/1042] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:10 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:10.711979 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c91f9cec-d402-4c7f-b859-ee5d4f402088 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:10.720009 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c91f9cec-d402-4c7f-b859-ee5d4f402088 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.159964 Aug 04 22:31:10.720578 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 526/1043] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:10 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:11.679465 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-873e6e91-65f8-473a-a7fe-5911ad18448e tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:11.680173 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-873e6e91-65f8-473a-a7fe-5911ad18448e tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:11.682530 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=40 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:31:11.687841 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-873e6e91-65f8-473a-a7fe-5911ad18448e tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:11.688331 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-873e6e91-65f8-473a-a7fe-5911ad18448e tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:11.688766 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-873e6e91-65f8-473a-a7fe-5911ad18448e tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:11.689497 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-873e6e91-65f8-473a-a7fe-5911ad18448e tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:11.689962 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-873e6e91-65f8-473a-a7fe-5911ad18448e tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:11.690393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-873e6e91-65f8-473a-a7fe-5911ad18448e tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:11.741341 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-cd3b42c9-beb8-42c1-99cb-27d6b4f924c7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:11.742069 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-cd3b42c9-beb8-42c1-99cb-27d6b4f924c7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:11.748474 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cd3b42c9-beb8-42c1-99cb-27d6b4f924c7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:11.749023 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cd3b42c9-beb8-42c1-99cb-27d6b4f924c7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:11.749553 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cd3b42c9-beb8-42c1-99cb-27d6b4f924c7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:11.750320 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cd3b42c9-beb8-42c1-99cb-27d6b4f924c7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:11.750777 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cd3b42c9-beb8-42c1-99cb-27d6b4f924c7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:11.751196 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cd3b42c9-beb8-42c1-99cb-27d6b4f924c7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:11.823501 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-873e6e91-65f8-473a-a7fe-5911ad18448e tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:11.826915 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:31:11.831724 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-873e6e91-65f8-473a-a7fe-5911ad18448e tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.156330 Aug 04 22:31:11.837443 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 518/1044] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:11 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:31:11.885596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-cd3b42c9-beb8-42c1-99cb-27d6b4f924c7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:11.893475 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-cd3b42c9-beb8-42c1-99cb-27d6b4f924c7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.156075 Aug 04 22:31:11.894041 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 527/1045] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:11 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:31:12.854034 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0258b7ab-f310-4f73-9930-9db3fca32942 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:12.854635 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0258b7ab-f310-4f73-9930-9db3fca32942 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:12.861573 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0258b7ab-f310-4f73-9930-9db3fca32942 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:12.862059 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0258b7ab-f310-4f73-9930-9db3fca32942 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:12.862494 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0258b7ab-f310-4f73-9930-9db3fca32942 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:12.863188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0258b7ab-f310-4f73-9930-9db3fca32942 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:12.864683 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0258b7ab-f310-4f73-9930-9db3fca32942 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:12.865117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0258b7ab-f310-4f73-9930-9db3fca32942 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:12.915354 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-951e4a82-c8ec-43db-83eb-5694eecdf0e1 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:12.915969 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-951e4a82-c8ec-43db-83eb-5694eecdf0e1 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:12.922467 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-951e4a82-c8ec-43db-83eb-5694eecdf0e1 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:12.922954 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-951e4a82-c8ec-43db-83eb-5694eecdf0e1 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:12.923386 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-951e4a82-c8ec-43db-83eb-5694eecdf0e1 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:12.924083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-951e4a82-c8ec-43db-83eb-5694eecdf0e1 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:12.924537 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-951e4a82-c8ec-43db-83eb-5694eecdf0e1 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:12.925137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-951e4a82-c8ec-43db-83eb-5694eecdf0e1 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:13.003467 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0258b7ab-f310-4f73-9930-9db3fca32942 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:13.011940 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0258b7ab-f310-4f73-9930-9db3fca32942 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.162053 Aug 04 22:31:13.012527 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 519/1046] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:12 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:13.058504 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-951e4a82-c8ec-43db-83eb-5694eecdf0e1 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:13.066430 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-951e4a82-c8ec-43db-83eb-5694eecdf0e1 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1727 microversion: 2.1 time: 0.155187 Aug 04 22:31:13.067660 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 528/1047] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:12 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:31:14.033402 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-acc0b023-50fc-4656-8a09-876940537eaf tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:14.034033 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-acc0b023-50fc-4656-8a09-876940537eaf tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:14.040595 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-acc0b023-50fc-4656-8a09-876940537eaf tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:14.041086 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-acc0b023-50fc-4656-8a09-876940537eaf tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:14.041560 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-acc0b023-50fc-4656-8a09-876940537eaf tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:14.042265 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-acc0b023-50fc-4656-8a09-876940537eaf tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:14.042725 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-acc0b023-50fc-4656-8a09-876940537eaf tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:14.043158 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-acc0b023-50fc-4656-8a09-876940537eaf tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:14.088871 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-548c93b8-9e08-4bdd-9271-14ea398da0b7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:14.089541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-548c93b8-9e08-4bdd-9271-14ea398da0b7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:14.091966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=40 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:31:14.097500 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-548c93b8-9e08-4bdd-9271-14ea398da0b7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:14.098042 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-548c93b8-9e08-4bdd-9271-14ea398da0b7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:14.098444 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-548c93b8-9e08-4bdd-9271-14ea398da0b7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:14.099183 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-548c93b8-9e08-4bdd-9271-14ea398da0b7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:14.099643 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-548c93b8-9e08-4bdd-9271-14ea398da0b7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:14.100071 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-548c93b8-9e08-4bdd-9271-14ea398da0b7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:14.180058 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-acc0b023-50fc-4656-8a09-876940537eaf tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:14.187972 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-acc0b023-50fc-4656-8a09-876940537eaf tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.158518 Aug 04 22:31:14.188572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 520/1048] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:14 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:31:14.234420 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-548c93b8-9e08-4bdd-9271-14ea398da0b7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:14.243218 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-548c93b8-9e08-4bdd-9271-14ea398da0b7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1704 microversion: 2.1 time: 0.158222 Aug 04 22:31:14.243783 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 529/1049] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:14 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1704 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:31:14.264096 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7e2046bf-9417-4ecc-ac8f-414027e9f416 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:31:14.271115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e2046bf-9417-4ecc-ac8f-414027e9f416 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:14.271606 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e2046bf-9417-4ecc-ac8f-414027e9f416 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:14.272044 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e2046bf-9417-4ecc-ac8f-414027e9f416 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:14.335435 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7e2046bf-9417-4ecc-ac8f-414027e9f416 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Going to try to start instance {{(pid=129197) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 22:31:14.377548 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7e2046bf-9417-4ecc-ac8f-414027e9f416 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "POST /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/action" status: 202 len: 0 microversion: 2.1 time: 0.117027 Aug 04 22:31:14.378144 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 521/1050] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:31:14 2022] POST /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:31:14.387038 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-84b5b6dc-d6bf-4d04-a490-e746e34fae5f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:14.387655 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-84b5b6dc-d6bf-4d04-a490-e746e34fae5f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:14.393886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84b5b6dc-d6bf-4d04-a490-e746e34fae5f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:14.394313 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84b5b6dc-d6bf-4d04-a490-e746e34fae5f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:14.395044 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84b5b6dc-d6bf-4d04-a490-e746e34fae5f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:14.396136 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84b5b6dc-d6bf-4d04-a490-e746e34fae5f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:14.396596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84b5b6dc-d6bf-4d04-a490-e746e34fae5f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:14.397024 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-84b5b6dc-d6bf-4d04-a490-e746e34fae5f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:14.531667 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-84b5b6dc-d6bf-4d04-a490-e746e34fae5f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:14.540801 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-84b5b6dc-d6bf-4d04-a490-e746e34fae5f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1713 microversion: 2.1 time: 0.157551 Aug 04 22:31:14.541579 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 530/1051] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:14 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:31:15.211977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-29c834ce-dd89-48ae-84ed-066047c8b2e5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:15.212606 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-29c834ce-dd89-48ae-84ed-066047c8b2e5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:15.218740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29c834ce-dd89-48ae-84ed-066047c8b2e5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:15.219225 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29c834ce-dd89-48ae-84ed-066047c8b2e5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:15.219660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29c834ce-dd89-48ae-84ed-066047c8b2e5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:15.220355 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29c834ce-dd89-48ae-84ed-066047c8b2e5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:15.221065 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29c834ce-dd89-48ae-84ed-066047c8b2e5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:15.221532 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29c834ce-dd89-48ae-84ed-066047c8b2e5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:15.350841 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-29c834ce-dd89-48ae-84ed-066047c8b2e5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:15.358297 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-29c834ce-dd89-48ae-84ed-066047c8b2e5 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.151250 Aug 04 22:31:15.358872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 522/1052] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:15 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:15.561983 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-94ac031e-f459-4c6b-922d-f9139b9c9d48 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:15.562521 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-94ac031e-f459-4c6b-922d-f9139b9c9d48 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:15.569003 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94ac031e-f459-4c6b-922d-f9139b9c9d48 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:15.569519 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94ac031e-f459-4c6b-922d-f9139b9c9d48 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:15.569963 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94ac031e-f459-4c6b-922d-f9139b9c9d48 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:15.570657 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94ac031e-f459-4c6b-922d-f9139b9c9d48 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:15.571113 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94ac031e-f459-4c6b-922d-f9139b9c9d48 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:15.571540 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-94ac031e-f459-4c6b-922d-f9139b9c9d48 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:15.705142 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-94ac031e-f459-4c6b-922d-f9139b9c9d48 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:15.713113 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-94ac031e-f459-4c6b-922d-f9139b9c9d48 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1713 microversion: 2.1 time: 0.155029 Aug 04 22:31:15.713713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 531/1053] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:15 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:31:16.380952 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-27569dfa-e489-4f1e-afc3-bd097afe3ab9 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:16.381528 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-27569dfa-e489-4f1e-afc3-bd097afe3ab9 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:16.387840 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-27569dfa-e489-4f1e-afc3-bd097afe3ab9 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:16.388319 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-27569dfa-e489-4f1e-afc3-bd097afe3ab9 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:16.388745 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-27569dfa-e489-4f1e-afc3-bd097afe3ab9 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:16.389448 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-27569dfa-e489-4f1e-afc3-bd097afe3ab9 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:16.389900 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-27569dfa-e489-4f1e-afc3-bd097afe3ab9 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:16.390320 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-27569dfa-e489-4f1e-afc3-bd097afe3ab9 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:16.522816 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-27569dfa-e489-4f1e-afc3-bd097afe3ab9 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:16.530325 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-27569dfa-e489-4f1e-afc3-bd097afe3ab9 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.153826 Aug 04 22:31:16.530900 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 523/1054] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:16 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:16.735802 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6dcebf21-b1a2-4a0a-912d-37c950da0b9b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:16.736351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6dcebf21-b1a2-4a0a-912d-37c950da0b9b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:16.743462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6dcebf21-b1a2-4a0a-912d-37c950da0b9b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:16.743940 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6dcebf21-b1a2-4a0a-912d-37c950da0b9b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:16.744371 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6dcebf21-b1a2-4a0a-912d-37c950da0b9b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:16.745057 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6dcebf21-b1a2-4a0a-912d-37c950da0b9b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:16.745534 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6dcebf21-b1a2-4a0a-912d-37c950da0b9b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:16.745960 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6dcebf21-b1a2-4a0a-912d-37c950da0b9b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:16.874462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6dcebf21-b1a2-4a0a-912d-37c950da0b9b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:16.883001 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6dcebf21-b1a2-4a0a-912d-37c950da0b9b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1717 microversion: 2.1 time: 0.151251 Aug 04 22:31:16.883572 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 532/1055] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:16 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:17.552365 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9f3fc85e-6dbe-441a-9ae0-be49c533fd51 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:17.552982 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-9f3fc85e-6dbe-441a-9ae0-be49c533fd51 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:17.559814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9f3fc85e-6dbe-441a-9ae0-be49c533fd51 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:17.560373 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9f3fc85e-6dbe-441a-9ae0-be49c533fd51 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:17.560833 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9f3fc85e-6dbe-441a-9ae0-be49c533fd51 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:17.561662 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9f3fc85e-6dbe-441a-9ae0-be49c533fd51 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:17.562142 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9f3fc85e-6dbe-441a-9ae0-be49c533fd51 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:17.562577 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9f3fc85e-6dbe-441a-9ae0-be49c533fd51 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:17.696068 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9f3fc85e-6dbe-441a-9ae0-be49c533fd51 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:17.704121 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9f3fc85e-6dbe-441a-9ae0-be49c533fd51 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.155774 Aug 04 22:31:17.704699 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 524/1056] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:17 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:18.727884 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8ef8c84e-34b7-4b1b-8b1c-24d0bc06c7de tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:18.728507 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8ef8c84e-34b7-4b1b-8b1c-24d0bc06c7de tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:18.734984 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8ef8c84e-34b7-4b1b-8b1c-24d0bc06c7de tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:18.735466 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8ef8c84e-34b7-4b1b-8b1c-24d0bc06c7de tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:18.735906 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8ef8c84e-34b7-4b1b-8b1c-24d0bc06c7de tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:18.736600 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8ef8c84e-34b7-4b1b-8b1c-24d0bc06c7de tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:18.737059 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8ef8c84e-34b7-4b1b-8b1c-24d0bc06c7de tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:18.737511 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8ef8c84e-34b7-4b1b-8b1c-24d0bc06c7de tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:18.873784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8ef8c84e-34b7-4b1b-8b1c-24d0bc06c7de tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:18.881468 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8ef8c84e-34b7-4b1b-8b1c-24d0bc06c7de tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.158995 Aug 04 22:31:18.882041 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 533/1057] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:18 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:19.902725 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2b14aff3-dc82-44e4-8bf1-c5fe67d6f818 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:19.903337 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2b14aff3-dc82-44e4-8bf1-c5fe67d6f818 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:19.910232 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2b14aff3-dc82-44e4-8bf1-c5fe67d6f818 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:19.911229 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2b14aff3-dc82-44e4-8bf1-c5fe67d6f818 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:19.911664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2b14aff3-dc82-44e4-8bf1-c5fe67d6f818 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:19.912354 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2b14aff3-dc82-44e4-8bf1-c5fe67d6f818 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:19.912807 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2b14aff3-dc82-44e4-8bf1-c5fe67d6f818 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:19.913235 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2b14aff3-dc82-44e4-8bf1-c5fe67d6f818 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:20.049150 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2b14aff3-dc82-44e4-8bf1-c5fe67d6f818 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:20.057875 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2b14aff3-dc82-44e4-8bf1-c5fe67d6f818 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.158889 Aug 04 22:31:20.058442 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 525/1058] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:19 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:21.078608 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f86f27e5-470b-4685-80a6-a89f6cec1fbc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:21.079222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f86f27e5-470b-4685-80a6-a89f6cec1fbc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:21.085858 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f86f27e5-470b-4685-80a6-a89f6cec1fbc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:21.086346 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f86f27e5-470b-4685-80a6-a89f6cec1fbc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:21.086785 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f86f27e5-470b-4685-80a6-a89f6cec1fbc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:21.087495 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f86f27e5-470b-4685-80a6-a89f6cec1fbc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:21.087949 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f86f27e5-470b-4685-80a6-a89f6cec1fbc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:21.088379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f86f27e5-470b-4685-80a6-a89f6cec1fbc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:21.224458 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f86f27e5-470b-4685-80a6-a89f6cec1fbc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:21.232105 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f86f27e5-470b-4685-80a6-a89f6cec1fbc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.157326 Aug 04 22:31:21.232681 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 534/1059] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:21 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:22.253771 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3bee7112-c4fa-422a-ab9c-09d6b1a95361 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:22.254388 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3bee7112-c4fa-422a-ab9c-09d6b1a95361 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:22.260880 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3bee7112-c4fa-422a-ab9c-09d6b1a95361 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:22.261366 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3bee7112-c4fa-422a-ab9c-09d6b1a95361 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:22.261839 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3bee7112-c4fa-422a-ab9c-09d6b1a95361 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:22.262531 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3bee7112-c4fa-422a-ab9c-09d6b1a95361 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:22.262991 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3bee7112-c4fa-422a-ab9c-09d6b1a95361 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:22.263420 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3bee7112-c4fa-422a-ab9c-09d6b1a95361 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:22.392524 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3bee7112-c4fa-422a-ab9c-09d6b1a95361 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:22.400414 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3bee7112-c4fa-422a-ab9c-09d6b1a95361 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.150750 Aug 04 22:31:22.400973 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 526/1060] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:22 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:23.422040 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-37ec2872-5be8-41c6-b4c9-901651f73a2c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:23.422789 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-37ec2872-5be8-41c6-b4c9-901651f73a2c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:23.429904 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-37ec2872-5be8-41c6-b4c9-901651f73a2c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:23.430390 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-37ec2872-5be8-41c6-b4c9-901651f73a2c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:23.430828 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-37ec2872-5be8-41c6-b4c9-901651f73a2c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:23.431528 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-37ec2872-5be8-41c6-b4c9-901651f73a2c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:23.431985 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-37ec2872-5be8-41c6-b4c9-901651f73a2c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:23.432415 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-37ec2872-5be8-41c6-b4c9-901651f73a2c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:23.570220 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-37ec2872-5be8-41c6-b4c9-901651f73a2c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:23.577724 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-37ec2872-5be8-41c6-b4c9-901651f73a2c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.159877 Aug 04 22:31:23.578283 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 535/1061] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:23 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:24.599217 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c57b454c-03cf-4c8a-b8fc-d19737e07f6d tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:24.599838 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c57b454c-03cf-4c8a-b8fc-d19737e07f6d tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:24.606305 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c57b454c-03cf-4c8a-b8fc-d19737e07f6d tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:24.606793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c57b454c-03cf-4c8a-b8fc-d19737e07f6d tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:24.607234 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c57b454c-03cf-4c8a-b8fc-d19737e07f6d tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:24.608201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c57b454c-03cf-4c8a-b8fc-d19737e07f6d tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:24.608664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c57b454c-03cf-4c8a-b8fc-d19737e07f6d tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:24.609093 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c57b454c-03cf-4c8a-b8fc-d19737e07f6d tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:24.738016 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c57b454c-03cf-4c8a-b8fc-d19737e07f6d tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:24.745430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c57b454c-03cf-4c8a-b8fc-d19737e07f6d tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1514 microversion: 2.1 time: 0.150491 Aug 04 22:31:24.746075 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 527/1062] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:24 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:24.766212 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-56eb6afa-6ca8-4888-b943-a3ea519f5180 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:31:24.766842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-56eb6afa-6ca8-4888-b943-a3ea519f5180 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:24.773898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-56eb6afa-6ca8-4888-b943-a3ea519f5180 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:24.774382 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-56eb6afa-6ca8-4888-b943-a3ea519f5180 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:24.774823 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-56eb6afa-6ca8-4888-b943-a3ea519f5180 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:24.775516 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-56eb6afa-6ca8-4888-b943-a3ea519f5180 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:24.775970 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-56eb6afa-6ca8-4888-b943-a3ea519f5180 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:24.776397 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-56eb6afa-6ca8-4888-b943-a3ea519f5180 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:24.804806 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-56eb6afa-6ca8-4888-b943-a3ea519f5180 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129196) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 22:31:24.869448 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-56eb6afa-6ca8-4888-b943-a3ea519f5180 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "POST /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d/action" status: 202 len: 0 microversion: 2.1 time: 0.106924 Aug 04 22:31:24.870302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 536/1063] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:31:24 2022] POST /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:31:24.878743 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-20a21b37-2310-4430-8ee2-563cfd4710cc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:24.878946 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-20a21b37-2310-4430-8ee2-563cfd4710cc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:24.884625 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20a21b37-2310-4430-8ee2-563cfd4710cc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:24.885122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20a21b37-2310-4430-8ee2-563cfd4710cc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:24.885598 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20a21b37-2310-4430-8ee2-563cfd4710cc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:24.886301 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20a21b37-2310-4430-8ee2-563cfd4710cc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:24.886760 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20a21b37-2310-4430-8ee2-563cfd4710cc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:24.887191 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20a21b37-2310-4430-8ee2-563cfd4710cc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:25.060296 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-20a21b37-2310-4430-8ee2-563cfd4710cc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:25.068540 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-20a21b37-2310-4430-8ee2-563cfd4710cc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1522 microversion: 2.1 time: 0.194080 Aug 04 22:31:25.069343 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 528/1064] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:24 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:26.090925 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1b1fbec2-8a96-4ed9-b80a-cd091be56e7f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:26.091542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1b1fbec2-8a96-4ed9-b80a-cd091be56e7f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:26.098311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b1fbec2-8a96-4ed9-b80a-cd091be56e7f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:26.098800 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b1fbec2-8a96-4ed9-b80a-cd091be56e7f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:26.099238 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b1fbec2-8a96-4ed9-b80a-cd091be56e7f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:26.099945 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b1fbec2-8a96-4ed9-b80a-cd091be56e7f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:26.100403 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b1fbec2-8a96-4ed9-b80a-cd091be56e7f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:26.100929 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b1fbec2-8a96-4ed9-b80a-cd091be56e7f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:26.245006 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1b1fbec2-8a96-4ed9-b80a-cd091be56e7f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:26.252716 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1b1fbec2-8a96-4ed9-b80a-cd091be56e7f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1524 microversion: 2.1 time: 0.166141 Aug 04 22:31:26.254203 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 537/1065] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:26 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1524 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:31:27.274444 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-636c9746-02e2-4690-9475-b88528cdccd8 req-859201d1-b9a0-43ea-a8b0-ef4c101929ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd73ce87-41fe-4b81-9b4b-546962f70b2d", "name": "network-vif-unplugged", "status": "completed", "tag": "568a695a-e288-47b9-b51b-cc0981c71810"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:31:27.275204 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b2c5d7fe-b433-4a5f-98ac-8bc0903344c8 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:27.276392 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b2c5d7fe-b433-4a5f-98ac-8bc0903344c8 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:27.284100 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b2c5d7fe-b433-4a5f-98ac-8bc0903344c8 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:27.284644 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b2c5d7fe-b433-4a5f-98ac-8bc0903344c8 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:27.285094 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b2c5d7fe-b433-4a5f-98ac-8bc0903344c8 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:27.286000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b2c5d7fe-b433-4a5f-98ac-8bc0903344c8 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:27.286310 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b2c5d7fe-b433-4a5f-98ac-8bc0903344c8 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:27.286806 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b2c5d7fe-b433-4a5f-98ac-8bc0903344c8 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:27.288585 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-636c9746-02e2-4690-9475-b88528cdccd8 req-859201d1-b9a0-43ea-a8b0-ef4c101929ff service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:27.289251 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-636c9746-02e2-4690-9475-b88528cdccd8 req-859201d1-b9a0-43ea-a8b0-ef4c101929ff service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:27.289872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-636c9746-02e2-4690-9475-b88528cdccd8 req-859201d1-b9a0-43ea-a8b0-ef4c101929ff service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:27.303555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-636c9746-02e2-4690-9475-b88528cdccd8 req-859201d1-b9a0-43ea-a8b0-ef4c101929ff service nova] Creating event network-vif-unplugged:568a695a-e288-47b9-b51b-cc0981c71810 for instance fd73ce87-41fe-4b81-9b4b-546962f70b2d on hv-cinder-85221 Aug 04 22:31:27.309463 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-636c9746-02e2-4690-9475-b88528cdccd8 req-859201d1-b9a0-43ea-a8b0-ef4c101929ff service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103896 Aug 04 22:31:27.310571 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 529/1066] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:31:27.420532 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b2c5d7fe-b433-4a5f-98ac-8bc0903344c8 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:27.429013 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b2c5d7fe-b433-4a5f-98ac-8bc0903344c8 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1580 microversion: 2.1 time: 0.157962 Aug 04 22:31:27.429651 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 538/1067] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:27 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1580 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:31:28.451088 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e1a885ff-74e9-455f-a0bf-c7644c703d90 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:28.451701 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e1a885ff-74e9-455f-a0bf-c7644c703d90 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:28.457844 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e1a885ff-74e9-455f-a0bf-c7644c703d90 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:28.458328 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e1a885ff-74e9-455f-a0bf-c7644c703d90 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:28.458765 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e1a885ff-74e9-455f-a0bf-c7644c703d90 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:28.459452 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e1a885ff-74e9-455f-a0bf-c7644c703d90 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:28.459902 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e1a885ff-74e9-455f-a0bf-c7644c703d90 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:28.460357 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e1a885ff-74e9-455f-a0bf-c7644c703d90 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:28.595227 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e1a885ff-74e9-455f-a0bf-c7644c703d90 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:28.603845 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e1a885ff-74e9-455f-a0bf-c7644c703d90 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1580 microversion: 2.1 time: 0.157523 Aug 04 22:31:28.604412 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 530/1068] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:28 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1580 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:31:29.625364 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8820c8fe-1f7c-4108-8ba1-f69b0e9ae2bd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:29.626004 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8820c8fe-1f7c-4108-8ba1-f69b0e9ae2bd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:29.633105 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8820c8fe-1f7c-4108-8ba1-f69b0e9ae2bd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:29.633628 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8820c8fe-1f7c-4108-8ba1-f69b0e9ae2bd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:29.634060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8820c8fe-1f7c-4108-8ba1-f69b0e9ae2bd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:29.634740 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8820c8fe-1f7c-4108-8ba1-f69b0e9ae2bd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:29.635187 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8820c8fe-1f7c-4108-8ba1-f69b0e9ae2bd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:29.635605 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8820c8fe-1f7c-4108-8ba1-f69b0e9ae2bd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:29.766566 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8820c8fe-1f7c-4108-8ba1-f69b0e9ae2bd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:29.774390 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8820c8fe-1f7c-4108-8ba1-f69b0e9ae2bd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1580 microversion: 2.1 time: 0.152830 Aug 04 22:31:29.774963 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 539/1069] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:29 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1580 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:30.796081 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-90fbf195-a1d9-4ca9-8bc0-bc11c3256fb4 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:30.796874 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-90fbf195-a1d9-4ca9-8bc0-bc11c3256fb4 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:30.803845 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-90fbf195-a1d9-4ca9-8bc0-bc11c3256fb4 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:30.804334 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-90fbf195-a1d9-4ca9-8bc0-bc11c3256fb4 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:30.804772 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-90fbf195-a1d9-4ca9-8bc0-bc11c3256fb4 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:30.805490 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-90fbf195-a1d9-4ca9-8bc0-bc11c3256fb4 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:30.805956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-90fbf195-a1d9-4ca9-8bc0-bc11c3256fb4 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:30.806384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-90fbf195-a1d9-4ca9-8bc0-bc11c3256fb4 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:30.935803 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-90fbf195-a1d9-4ca9-8bc0-bc11c3256fb4 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:30.944160 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-90fbf195-a1d9-4ca9-8bc0-bc11c3256fb4 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1580 microversion: 2.1 time: 0.151956 Aug 04 22:31:30.944753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 531/1070] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:30 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1580 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:31.965970 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-2b5d5ee0-bf82-4578-9522-8360f9c5d4d0 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:31.966583 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-2b5d5ee0-bf82-4578-9522-8360f9c5d4d0 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:31.973641 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2b5d5ee0-bf82-4578-9522-8360f9c5d4d0 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:31.974122 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2b5d5ee0-bf82-4578-9522-8360f9c5d4d0 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:31.974554 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2b5d5ee0-bf82-4578-9522-8360f9c5d4d0 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:31.975239 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2b5d5ee0-bf82-4578-9522-8360f9c5d4d0 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:31.975693 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2b5d5ee0-bf82-4578-9522-8360f9c5d4d0 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:31.976113 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2b5d5ee0-bf82-4578-9522-8360f9c5d4d0 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:31.980011 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:31:32.110959 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2b5d5ee0-bf82-4578-9522-8360f9c5d4d0 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:32.119316 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-2b5d5ee0-bf82-4578-9522-8360f9c5d4d0 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1580 microversion: 2.1 time: 0.157183 Aug 04 22:31:32.119878 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 540/1071] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:31 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1580 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:33.140031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-fca529da-933f-4c48-8406-906a32c42519 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:33.140648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-fca529da-933f-4c48-8406-906a32c42519 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:33.147250 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fca529da-933f-4c48-8406-906a32c42519 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:33.147732 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fca529da-933f-4c48-8406-906a32c42519 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:33.148164 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fca529da-933f-4c48-8406-906a32c42519 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:33.148853 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fca529da-933f-4c48-8406-906a32c42519 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:33.149311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fca529da-933f-4c48-8406-906a32c42519 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:33.149762 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fca529da-933f-4c48-8406-906a32c42519 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:33.281680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-fca529da-933f-4c48-8406-906a32c42519 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:33.289699 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-fca529da-933f-4c48-8406-906a32c42519 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1580 microversion: 2.1 time: 0.153410 Aug 04 22:31:33.290205 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 532/1072] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:33 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:34.311410 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3c93d1d4-484a-4ee5-872c-c246f614132b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:34.312092 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3c93d1d4-484a-4ee5-872c-c246f614132b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:34.318958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3c93d1d4-484a-4ee5-872c-c246f614132b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:34.319434 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3c93d1d4-484a-4ee5-872c-c246f614132b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:34.319865 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3c93d1d4-484a-4ee5-872c-c246f614132b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:34.320549 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3c93d1d4-484a-4ee5-872c-c246f614132b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:34.321001 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3c93d1d4-484a-4ee5-872c-c246f614132b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:34.321453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3c93d1d4-484a-4ee5-872c-c246f614132b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:34.447710 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3c93d1d4-484a-4ee5-872c-c246f614132b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:34.455020 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3c93d1d4-484a-4ee5-872c-c246f614132b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1580 microversion: 2.1 time: 0.147420 Aug 04 22:31:34.456193 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 541/1073] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:34 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1580 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:35.476824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-65942009-196f-464b-a6ec-877da993ef05 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:35.477495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-65942009-196f-464b-a6ec-877da993ef05 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:35.483969 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-65942009-196f-464b-a6ec-877da993ef05 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:35.484459 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-65942009-196f-464b-a6ec-877da993ef05 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:35.484934 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-65942009-196f-464b-a6ec-877da993ef05 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:35.485659 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-65942009-196f-464b-a6ec-877da993ef05 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:35.486120 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-65942009-196f-464b-a6ec-877da993ef05 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:35.486559 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-65942009-196f-464b-a6ec-877da993ef05 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:35.619607 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-65942009-196f-464b-a6ec-877da993ef05 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:35.627009 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-65942009-196f-464b-a6ec-877da993ef05 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1580 microversion: 2.1 time: 0.153997 Aug 04 22:31:35.627811 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 533/1074] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:35 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:36.648430 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9238563e-2157-4d64-af25-7003c368c3bc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:36.648974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9238563e-2157-4d64-af25-7003c368c3bc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:36.655393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9238563e-2157-4d64-af25-7003c368c3bc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:36.655874 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9238563e-2157-4d64-af25-7003c368c3bc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:36.656307 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9238563e-2157-4d64-af25-7003c368c3bc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:36.657023 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9238563e-2157-4d64-af25-7003c368c3bc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:36.657496 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9238563e-2157-4d64-af25-7003c368c3bc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:36.657924 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9238563e-2157-4d64-af25-7003c368c3bc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:36.790644 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9238563e-2157-4d64-af25-7003c368c3bc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:36.798141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9238563e-2157-4d64-af25-7003c368c3bc tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1580 microversion: 2.1 time: 0.153621 Aug 04 22:31:36.798709 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 542/1075] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:36 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:37.820109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-70c757e9-7b01-448c-bfc4-d23dfaa4c7a2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:37.820665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-70c757e9-7b01-448c-bfc4-d23dfaa4c7a2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:37.827052 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-70c757e9-7b01-448c-bfc4-d23dfaa4c7a2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:37.827566 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-70c757e9-7b01-448c-bfc4-d23dfaa4c7a2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:37.828003 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-70c757e9-7b01-448c-bfc4-d23dfaa4c7a2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:37.828699 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-70c757e9-7b01-448c-bfc4-d23dfaa4c7a2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:37.829157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-70c757e9-7b01-448c-bfc4-d23dfaa4c7a2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:37.829621 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-70c757e9-7b01-448c-bfc4-d23dfaa4c7a2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:37.960932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-70c757e9-7b01-448c-bfc4-d23dfaa4c7a2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:37.968416 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-70c757e9-7b01-448c-bfc4-d23dfaa4c7a2 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1567 microversion: 2.1 time: 0.152276 Aug 04 22:31:37.968992 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 534/1076] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:31:37 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:39.368143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-b75cc6c3-071f-40e9-93b2-bca7b8bbe554 req-5588d2b7-eba2-4846-b9cc-d740c6d505ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd73ce87-41fe-4b81-9b4b-546962f70b2d", "name": "network-vif-plugged", "status": "completed", "tag": "568a695a-e288-47b9-b51b-cc0981c71810"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:31:39.379052 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-b75cc6c3-071f-40e9-93b2-bca7b8bbe554 req-5588d2b7-eba2-4846-b9cc-d740c6d505ed service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:39.379542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-b75cc6c3-071f-40e9-93b2-bca7b8bbe554 req-5588d2b7-eba2-4846-b9cc-d740c6d505ed service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:39.380078 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-b75cc6c3-071f-40e9-93b2-bca7b8bbe554 req-5588d2b7-eba2-4846-b9cc-d740c6d505ed service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:39.392596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-b75cc6c3-071f-40e9-93b2-bca7b8bbe554 req-5588d2b7-eba2-4846-b9cc-d740c6d505ed service nova] Creating event network-vif-plugged:568a695a-e288-47b9-b51b-cc0981c71810 for instance fd73ce87-41fe-4b81-9b4b-546962f70b2d on hv-cinder-85221 Aug 04 22:31:39.397740 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-b75cc6c3-071f-40e9-93b2-bca7b8bbe554 req-5588d2b7-eba2-4846-b9cc-d740c6d505ed service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033166 Aug 04 22:31:39.398524 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 543/1077] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:31:51.919841 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c27a5989-8d4a-4635-b57c-0abbc38ce76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:51.922083 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c27a5989-8d4a-4635-b57c-0abbc38ce76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:51.924732 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=33 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:31:51.925392 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:31:51.931244 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c27a5989-8d4a-4635-b57c-0abbc38ce76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:51.931733 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c27a5989-8d4a-4635-b57c-0abbc38ce76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:51.932175 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c27a5989-8d4a-4635-b57c-0abbc38ce76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:51.932876 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c27a5989-8d4a-4635-b57c-0abbc38ce76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:51.933337 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c27a5989-8d4a-4635-b57c-0abbc38ce76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:51.933793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c27a5989-8d4a-4635-b57c-0abbc38ce76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:51.966126 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c27a5989-8d4a-4635-b57c-0abbc38ce76a tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050400 Aug 04 22:31:51.966684 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 535/1078] 10.222.0.109 () {60 vars in 1348 bytes} [Thu Aug 4 22:31:51 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:31:52.028423 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-007af380-3944-413e-bb0d-72dcca6f68b3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:52.028993 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-007af380-3944-413e-bb0d-72dcca6f68b3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:52.031580 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:31:52.032951 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=18 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:31:52.039536 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-007af380-3944-413e-bb0d-72dcca6f68b3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:52.040020 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-007af380-3944-413e-bb0d-72dcca6f68b3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:52.040458 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-007af380-3944-413e-bb0d-72dcca6f68b3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:52.041154 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-007af380-3944-413e-bb0d-72dcca6f68b3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:52.041671 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-007af380-3944-413e-bb0d-72dcca6f68b3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:52.042103 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-007af380-3944-413e-bb0d-72dcca6f68b3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:52.067481 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-007af380-3944-413e-bb0d-72dcca6f68b3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Going to try to terminate instance {{(pid=129196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:31:52.146122 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-007af380-3944-413e-bb0d-72dcca6f68b3 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "DELETE /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 204 len: 0 microversion: 2.20 time: 0.121562 Aug 04 22:31:52.146836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 544/1079] 10.222.0.109 () {60 vars in 1285 bytes} [Thu Aug 4 22:31:52 2022] DELETE /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 22:31:52.156596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c8cb637a-4978-4f90-900a-8712207ed615 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:52.158021 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c8cb637a-4978-4f90-900a-8712207ed615 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:52.164468 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c8cb637a-4978-4f90-900a-8712207ed615 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:52.164975 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c8cb637a-4978-4f90-900a-8712207ed615 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:52.165397 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c8cb637a-4978-4f90-900a-8712207ed615 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:52.166127 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c8cb637a-4978-4f90-900a-8712207ed615 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:52.166584 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c8cb637a-4978-4f90-900a-8712207ed615 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:52.167007 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c8cb637a-4978-4f90-900a-8712207ed615 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:52.296574 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c8cb637a-4978-4f90-900a-8712207ed615 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:52.305908 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c8cb637a-4978-4f90-900a-8712207ed615 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:52.308665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c8cb637a-4978-4f90-900a-8712207ed615 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:52.310731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c8cb637a-4978-4f90-900a-8712207ed615 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.158538 Aug 04 22:31:52.311659 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 536/1080] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:31:52 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 22:31:53.335936 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f5566409-ec4a-4f4b-a7eb-e258400bc176 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:53.336642 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f5566409-ec4a-4f4b-a7eb-e258400bc176 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:53.343104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f5566409-ec4a-4f4b-a7eb-e258400bc176 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:53.343839 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f5566409-ec4a-4f4b-a7eb-e258400bc176 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:53.344284 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f5566409-ec4a-4f4b-a7eb-e258400bc176 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:53.345219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f5566409-ec4a-4f4b-a7eb-e258400bc176 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:53.345804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f5566409-ec4a-4f4b-a7eb-e258400bc176 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:53.346409 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f5566409-ec4a-4f4b-a7eb-e258400bc176 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:53.475622 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f5566409-ec4a-4f4b-a7eb-e258400bc176 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:53.483811 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f5566409-ec4a-4f4b-a7eb-e258400bc176 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:53.485948 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f5566409-ec4a-4f4b-a7eb-e258400bc176 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:53.487207 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f5566409-ec4a-4f4b-a7eb-e258400bc176 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.155638 Aug 04 22:31:53.487768 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 545/1081] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:31:53 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:31:54.511495 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-29adb700-a12b-473f-aea7-6ed0cc5596c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:54.512107 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-29adb700-a12b-473f-aea7-6ed0cc5596c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:54.520027 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29adb700-a12b-473f-aea7-6ed0cc5596c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:54.520515 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29adb700-a12b-473f-aea7-6ed0cc5596c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:54.520950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29adb700-a12b-473f-aea7-6ed0cc5596c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:54.521681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29adb700-a12b-473f-aea7-6ed0cc5596c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:54.522139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29adb700-a12b-473f-aea7-6ed0cc5596c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:54.522617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-29adb700-a12b-473f-aea7-6ed0cc5596c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:54.859723 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-29adb700-a12b-473f-aea7-6ed0cc5596c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:54.868095 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-29adb700-a12b-473f-aea7-6ed0cc5596c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:54.869640 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-29adb700-a12b-473f-aea7-6ed0cc5596c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c0aa2b9a5ac46f9bede8d007dcd3504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d013d03bbc4f8ead46aca55d441eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:31:54.870806 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-29adb700-a12b-473f-aea7-6ed0cc5596c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 200 len: 1730 microversion: 2.20 time: 0.363256 Aug 04 22:31:54.871581 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 537/1082] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:31:54 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 1730 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 22:31:55.370612 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-746dc9e7-022d-4081-b9f3-1590336e0301 req-6e76e618-cb77-433f-8a2f-52df5ea3d70a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e61c4e-2c74-44c2-90bd-f997db2fbd0a", "name": "network-vif-deleted", "tag": "9bb4a82b-caa1-4ea9-a34f-05e170ce6471"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:31:55.381912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-746dc9e7-022d-4081-b9f3-1590336e0301 req-6e76e618-cb77-433f-8a2f-52df5ea3d70a service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:55.382684 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-746dc9e7-022d-4081-b9f3-1590336e0301 req-6e76e618-cb77-433f-8a2f-52df5ea3d70a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:55.383321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-746dc9e7-022d-4081-b9f3-1590336e0301 req-6e76e618-cb77-433f-8a2f-52df5ea3d70a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:55.396017 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-746dc9e7-022d-4081-b9f3-1590336e0301 req-6e76e618-cb77-433f-8a2f-52df5ea3d70a service nova] Creating event network-vif-deleted:9bb4a82b-caa1-4ea9-a34f-05e170ce6471 for instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a on hv-cinder-85221 Aug 04 22:31:55.402844 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-746dc9e7-022d-4081-b9f3-1590336e0301 req-6e76e618-cb77-433f-8a2f-52df5ea3d70a service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101774 Aug 04 22:31:55.404992 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 546/1083] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:31:55.894077 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ca417c86-c208-44fb-b7e8-2e1b24e60165 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:55.895400 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ca417c86-c208-44fb-b7e8-2e1b24e60165 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:55.902850 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ca417c86-c208-44fb-b7e8-2e1b24e60165 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:55.903346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ca417c86-c208-44fb-b7e8-2e1b24e60165 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:55.903789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ca417c86-c208-44fb-b7e8-2e1b24e60165 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:55.904498 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ca417c86-c208-44fb-b7e8-2e1b24e60165 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:55.904962 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ca417c86-c208-44fb-b7e8-2e1b24e60165 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:55.905390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ca417c86-c208-44fb-b7e8-2e1b24e60165 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:55.919472 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-ca417c86-c208-44fb-b7e8-2e1b24e60165 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] HTTP exception thrown: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ca417c86-c208-44fb-b7e8-2e1b24e60165 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Request method failure captured: Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a HTTP/1.1 Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYgIR9TWa02DixwRuI9JW-Nzd3cRgdYjC9HycYiUFfTZbOLQ9r6lQgS8f9umJI1hZWiTwYSaOSrZE84-3bBOgRilYmlQbR0xxiLdzDZdieq9wwY_7IdM4wxZYa8P3PRUE-U2karUzYImG3Egn1Q23LD9lr7Si9YnLEVlVMt5n0dpSQ Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 21d013d03bbc4f8ead46aca55d441eb1 Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:31:55.921727 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:31:55.924157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/21d013d03bbc4f8ead46aca55d441eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_21d013d03bbc4f8ead46aca55d441eb1", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/21d013d03bbc4f8ead46aca55d441eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/21d013d03bbc4f8ead46aca55d441eb1"}]}] Aug 04 22:31:55.924157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:55.924157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 21d013d03bbc4f8ead46aca55d441eb1 Aug 04 22:31:55.924157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:55.924157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-AttachVolumeShelveTestJSON-1532738363-project Aug 04 22:31:55.924157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:31:55.924157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:31:55.924157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 8c0aa2b9a5ac46f9bede8d007dcd3504 Aug 04 22:31:55.924157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1532738363-project Aug 04 22:31:55.924157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:31:55.924157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:55.924157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '51e61c4e-2c74-44c2-90bd-f997db2fbd0a'} Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:31:55.928681 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:55.930780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:55.932137 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ca417c86-c208-44fb-b7e8-2e1b24e60165 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Returning 404 to user: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:31:55.932137 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ca417c86-c208-44fb-b7e8-2e1b24e60165 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 404 len: 111 microversion: 2.20 time: 0.034368 Aug 04 22:31:55.932137 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 538/1084] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:31:55 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 22:31:55.937317 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7bdf26af-d1a9-4b4b-95be-2b466c732062 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '.version_select at 0x7fe7b203d550>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:55.957199 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7bdf26af-d1a9-4b4b-95be-2b466c732062 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135478882" status: 204 len: 0 microversion: 2.20 time: 0.025065 Aug 04 22:31:55.957817 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 547/1085] 10.222.0.109 () {60 vars in 1267 bytes} [Thu Aug 4 22:31:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135478882 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 22:31:57.731604 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-fc054fbb-2b3a-4f87-aec9-7364897c15c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:57.732112 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-fc054fbb-2b3a-4f87-aec9-7364897c15c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:57.739142 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc054fbb-2b3a-4f87-aec9-7364897c15c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:57.739636 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc054fbb-2b3a-4f87-aec9-7364897c15c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:57.740078 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc054fbb-2b3a-4f87-aec9-7364897c15c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:57.740864 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc054fbb-2b3a-4f87-aec9-7364897c15c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:57.741330 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc054fbb-2b3a-4f87-aec9-7364897c15c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:57.741784 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-fc054fbb-2b3a-4f87-aec9-7364897c15c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:57.755321 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-fc054fbb-2b3a-4f87-aec9-7364897c15c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] HTTP exception thrown: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-fc054fbb-2b3a-4f87-aec9-7364897c15c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Request method failure captured: Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: DELETE /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a HTTP/1.1 Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYgIR9TWa02DixwRuI9JW-Nzd3cRgdYjC9HycYiUFfTZbOLQ9r6lQgS8f9umJI1hZWiTwYSaOSrZE84-3bBOgRilYmlQbR0xxiLdzDZdieq9wwY_7IdM4wxZYa8P3PRUE-U2karUzYImG3Egn1Q23LD9lr7Si9YnLEVlVMt5n0dpSQ Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 21d013d03bbc4f8ead46aca55d441eb1 Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:31:57.756872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:31:57.758596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/21d013d03bbc4f8ead46aca55d441eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_21d013d03bbc4f8ead46aca55d441eb1", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/21d013d03bbc4f8ead46aca55d441eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/21d013d03bbc4f8ead46aca55d441eb1"}]}] Aug 04 22:31:57.758596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:57.758596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 21d013d03bbc4f8ead46aca55d441eb1 Aug 04 22:31:57.758596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:57.758596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-AttachVolumeShelveTestJSON-1532738363-project Aug 04 22:31:57.758596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:31:57.758596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:31:57.758596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 8c0aa2b9a5ac46f9bede8d007dcd3504 Aug 04 22:31:57.758596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1532738363-project Aug 04 22:31:57.758596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:31:57.758596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:57.758596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '51e61c4e-2c74-44c2-90bd-f997db2fbd0a'} Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:31:57.759390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:57.760586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:57.761883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-fc054fbb-2b3a-4f87-aec9-7364897c15c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Returning 404 to user: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:31:57.761883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-fc054fbb-2b3a-4f87-aec9-7364897c15c9 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "DELETE /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 404 len: 111 microversion: 2.20 time: 0.030688 Aug 04 22:31:57.761883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 539/1086] 10.222.0.109 () {60 vars in 1285 bytes} [Thu Aug 4 22:31:57 2022] DELETE /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 22:31:57.767992 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d6a1b686-ded8-4b2e-91fd-9f785d61ef53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:57.768717 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d6a1b686-ded8-4b2e-91fd-9f785d61ef53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: 51e61c4e-2c74-44c2-90bd-f997db2fbd0a] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:57.775216 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6a1b686-ded8-4b2e-91fd-9f785d61ef53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:57.775691 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6a1b686-ded8-4b2e-91fd-9f785d61ef53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:57.776119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6a1b686-ded8-4b2e-91fd-9f785d61ef53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:57.776801 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6a1b686-ded8-4b2e-91fd-9f785d61ef53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:57.777244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6a1b686-ded8-4b2e-91fd-9f785d61ef53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:57.777684 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d6a1b686-ded8-4b2e-91fd-9f785d61ef53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:57.791007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-d6a1b686-ded8-4b2e-91fd-9f785d61ef53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] HTTP exception thrown: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d6a1b686-ded8-4b2e-91fd-9f785d61ef53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Request method failure captured: Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a HTTP/1.1 Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYgIR9TWa02DixwRuI9JW-Nzd3cRgdYjC9HycYiUFfTZbOLQ9r6lQgS8f9umJI1hZWiTwYSaOSrZE84-3bBOgRilYmlQbR0xxiLdzDZdieq9wwY_7IdM4wxZYa8P3PRUE-U2karUzYImG3Egn1Q23LD9lr7Si9YnLEVlVMt5n0dpSQ Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 21d013d03bbc4f8ead46aca55d441eb1 Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:31:57.792767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:31:57.794442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/21d013d03bbc4f8ead46aca55d441eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_21d013d03bbc4f8ead46aca55d441eb1", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/21d013d03bbc4f8ead46aca55d441eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/21d013d03bbc4f8ead46aca55d441eb1"}]}] Aug 04 22:31:57.794442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:57.794442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 21d013d03bbc4f8ead46aca55d441eb1 Aug 04 22:31:57.794442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:57.794442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeShelveTestJSON-1532738363-project Aug 04 22:31:57.794442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:31:57.794442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:31:57.794442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 8c0aa2b9a5ac46f9bede8d007dcd3504 Aug 04 22:31:57.794442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1532738363-project Aug 04 22:31:57.794442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:31:57.794442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:57.794442 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': '51e61c4e-2c74-44c2-90bd-f997db2fbd0a'} Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:31:57.795286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. Aug 04 22:31:57.796741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:31:57.798196 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d6a1b686-ded8-4b2e-91fd-9f785d61ef53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Returning 404 to user: Instance 51e61c4e-2c74-44c2-90bd-f997db2fbd0a could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:31:57.798196 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d6a1b686-ded8-4b2e-91fd-9f785d61ef53 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a" status: 404 len: 111 microversion: 2.20 time: 0.031407 Aug 04 22:31:57.798196 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 548/1087] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:31:57 2022] GET /compute/v2.1/servers/51e61c4e-2c74-44c2-90bd-f997db2fbd0a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 22:31:58.931686 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a8e05269-a67c-4d14-b8bd-378bb4d06496 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:58.932455 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a8e05269-a67c-4d14-b8bd-378bb4d06496 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:58.939841 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a8e05269-a67c-4d14-b8bd-378bb4d06496 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:58.940447 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a8e05269-a67c-4d14-b8bd-378bb4d06496 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:58.940987 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a8e05269-a67c-4d14-b8bd-378bb4d06496 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:58.941719 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a8e05269-a67c-4d14-b8bd-378bb4d06496 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:58.942208 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a8e05269-a67c-4d14-b8bd-378bb4d06496 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:58.942743 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a8e05269-a67c-4d14-b8bd-378bb4d06496 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:58.958745 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-a8e05269-a67c-4d14-b8bd-378bb4d06496 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] HTTP exception thrown: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a8e05269-a67c-4d14-b8bd-378bb4d06496 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Request method failure captured: Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: DELETE /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 HTTP/1.1 Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYgIR9TWa02DixwRuI9JW-Nzd3cRgdYjC9HycYiUFfTZbOLQ9r6lQgS8f9umJI1hZWiTwYSaOSrZE84-3bBOgRilYmlQbR0xxiLdzDZdieq9wwY_7IdM4wxZYa8P3PRUE-U2karUzYImG3Egn1Q23LD9lr7Si9YnLEVlVMt5n0dpSQ Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 21d013d03bbc4f8ead46aca55d441eb1 Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:31:58.960299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:31:58.962056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/21d013d03bbc4f8ead46aca55d441eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_21d013d03bbc4f8ead46aca55d441eb1", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/21d013d03bbc4f8ead46aca55d441eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/21d013d03bbc4f8ead46aca55d441eb1"}]}] Aug 04 22:31:58.962056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:58.962056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 21d013d03bbc4f8ead46aca55d441eb1 Aug 04 22:31:58.962056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:58.962056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-AttachVolumeShelveTestJSON-1532738363-project Aug 04 22:31:58.962056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:31:58.962056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:31:58.962056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 8c0aa2b9a5ac46f9bede8d007dcd3504 Aug 04 22:31:58.962056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1532738363-project Aug 04 22:31:58.962056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:31:58.962056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:31:58.962056 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': 'eb440660-4715-48f6-a7ff-f0b74dfefe21'} Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:31:58.962943 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:31:58.964433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:31:58.965956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a8e05269-a67c-4d14-b8bd-378bb4d06496 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Returning 404 to user: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:31:58.965956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a8e05269-a67c-4d14-b8bd-378bb4d06496 tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "DELETE /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 404 len: 111 microversion: 2.20 time: 0.033868 Aug 04 22:31:58.965956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 540/1088] 10.222.0.109 () {60 vars in 1285 bytes} [Thu Aug 4 22:31:58 2022] DELETE /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 22:31:58.970692 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-664d0b1f-fcf3-4990-9cf5-7ae6f54cad9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:31:58.971319 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-664d0b1f-fcf3-4990-9cf5-7ae6f54cad9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] [instance: eb440660-4715-48f6-a7ff-f0b74dfefe21] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:31:58.977690 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-664d0b1f-fcf3-4990-9cf5-7ae6f54cad9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:58.978167 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-664d0b1f-fcf3-4990-9cf5-7ae6f54cad9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:58.978594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-664d0b1f-fcf3-4990-9cf5-7ae6f54cad9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:58.979276 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-664d0b1f-fcf3-4990-9cf5-7ae6f54cad9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:31:58.979726 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-664d0b1f-fcf3-4990-9cf5-7ae6f54cad9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:31:58.980145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-664d0b1f-fcf3-4990-9cf5-7ae6f54cad9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:31:58.995462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-664d0b1f-fcf3-4990-9cf5-7ae6f54cad9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] HTTP exception thrown: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-664d0b1f-fcf3-4990-9cf5-7ae6f54cad9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Request method failure captured: Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 HTTP/1.1 Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYgIR9TWa02DixwRuI9JW-Nzd3cRgdYjC9HycYiUFfTZbOLQ9r6lQgS8f9umJI1hZWiTwYSaOSrZE84-3bBOgRilYmlQbR0xxiLdzDZdieq9wwY_7IdM4wxZYa8P3PRUE-U2karUzYImG3Egn1Q23LD9lr7Si9YnLEVlVMt5n0dpSQ Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 21d013d03bbc4f8ead46aca55d441eb1 Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:31:58.996980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:31:58.998614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/21d013d03bbc4f8ead46aca55d441eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_21d013d03bbc4f8ead46aca55d441eb1", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/21d013d03bbc4f8ead46aca55d441eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/21d013d03bbc4f8ead46aca55d441eb1"}]}] Aug 04 22:31:58.998614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:58.998614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 21d013d03bbc4f8ead46aca55d441eb1 Aug 04 22:31:58.998614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1532738363 Aug 04 22:31:58.998614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeShelveTestJSON-1532738363-project Aug 04 22:31:58.998614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:31:58.998614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:31:58.998614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 8c0aa2b9a5ac46f9bede8d007dcd3504 Aug 04 22:31:58.998614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1532738363-project Aug 04 22:31:58.998614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:31:58.998614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:31:58.998614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'eb440660-4715-48f6-a7ff-f0b74dfefe21'} Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:31:59.000051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. Aug 04 22:31:59.002791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:31:59.004114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-664d0b1f-fcf3-4990-9cf5-7ae6f54cad9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] Returning 404 to user: Instance eb440660-4715-48f6-a7ff-f0b74dfefe21 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:31:59.004114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-664d0b1f-fcf3-4990-9cf5-7ae6f54cad9d tempest-AttachVolumeShelveTestJSON-1532738363 tempest-AttachVolumeShelveTestJSON-1532738363-project] 10.222.0.109 "GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21" status: 404 len: 111 microversion: 2.20 time: 0.032034 Aug 04 22:31:59.004114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 549/1089] 10.222.0.109 () {60 vars in 1282 bytes} [Thu Aug 4 22:31:58 2022] GET /compute/v2.1/servers/eb440660-4715-48f6-a7ff-f0b74dfefe21 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 22:32:17.301864 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0de34860-2a51-41d2-910b-b70f9cc6ab2d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:17.302404 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0de34860-2a51-41d2-910b-b70f9cc6ab2d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:17.304550 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=12 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:32:17.305242 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=24 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:32:17.310895 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0de34860-2a51-41d2-910b-b70f9cc6ab2d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:17.311382 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0de34860-2a51-41d2-910b-b70f9cc6ab2d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:17.311823 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0de34860-2a51-41d2-910b-b70f9cc6ab2d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:17.313185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0de34860-2a51-41d2-910b-b70f9cc6ab2d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:17.313720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0de34860-2a51-41d2-910b-b70f9cc6ab2d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:17.314256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0de34860-2a51-41d2-910b-b70f9cc6ab2d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:17.337256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0de34860-2a51-41d2-910b-b70f9cc6ab2d tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/ips" status: 200 len: 150 microversion: 2.1 time: 0.039201 Aug 04 22:32:17.337857 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 541/1090] 10.222.0.109 () {58 vars in 1253 bytes} [Thu Aug 4 22:32:17 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:32:18.688248 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a379aefe-d82e-49a6-b571-d9502d44cc2c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c7e781c-f56a-471f-8646-7ef7b1056317"}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:32:18.690710 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a379aefe-d82e-49a6-b571-d9502d44cc2c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:18.692930 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:32:18.693611 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:32:18.700081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a379aefe-d82e-49a6-b571-d9502d44cc2c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:18.700606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a379aefe-d82e-49a6-b571-d9502d44cc2c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:18.701051 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a379aefe-d82e-49a6-b571-d9502d44cc2c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:18.701784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a379aefe-d82e-49a6-b571-d9502d44cc2c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:18.702242 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a379aefe-d82e-49a6-b571-d9502d44cc2c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:18.702696 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a379aefe-d82e-49a6-b571-d9502d44cc2c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:19.006268 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a379aefe-d82e-49a6-b571-d9502d44cc2c tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "POST /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322063 Aug 04 22:32:19.006905 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 550/1091] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:32:18 2022] POST /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:32:22.883298 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-97974806-4528-4bf6-9723-94ee0ae15a0f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:22.883922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-97974806-4528-4bf6-9723-94ee0ae15a0f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:22.890148 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-97974806-4528-4bf6-9723-94ee0ae15a0f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:22.890627 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-97974806-4528-4bf6-9723-94ee0ae15a0f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:22.891061 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-97974806-4528-4bf6-9723-94ee0ae15a0f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:22.891744 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-97974806-4528-4bf6-9723-94ee0ae15a0f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:22.892192 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-97974806-4528-4bf6-9723-94ee0ae15a0f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:22.892613 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-97974806-4528-4bf6-9723-94ee0ae15a0f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:22.975256 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.objects.instance [None req-97974806-4528-4bf6-9723-94ee0ae15a0f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lazy-loading 'services' on Instance uuid 2baedf2f-2718-4cb2-a417-a230761f4002 {{(pid=129197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:32:23.048264 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-97974806-4528-4bf6-9723-94ee0ae15a0f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "DELETE /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/os-volume_attachments/eeb987e7-75c6-4bbb-af38-7e685084bd17" status: 202 len: 0 microversion: 2.1 time: 0.168836 Aug 04 22:32:23.049019 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 542/1092] 10.222.0.109 () {58 vars in 1421 bytes} [Thu Aug 4 22:32:22 2022] DELETE /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/os-volume_attachments/eeb987e7-75c6-4bbb-af38-7e685084bd17 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 22:32:26.636545 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-904f6279-05cd-4c9b-801e-5cf371f503a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:26.637161 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-904f6279-05cd-4c9b-801e-5cf371f503a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:26.645093 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-904f6279-05cd-4c9b-801e-5cf371f503a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:26.645617 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-904f6279-05cd-4c9b-801e-5cf371f503a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:26.646062 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-904f6279-05cd-4c9b-801e-5cf371f503a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:26.646760 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-904f6279-05cd-4c9b-801e-5cf371f503a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:26.647244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-904f6279-05cd-4c9b-801e-5cf371f503a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:26.647671 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-904f6279-05cd-4c9b-801e-5cf371f503a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:26.731023 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-904f6279-05cd-4c9b-801e-5cf371f503a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lazy-loading 'services' on Instance uuid 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:32:26.813606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-904f6279-05cd-4c9b-801e-5cf371f503a5 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/os-volume_attachments/1c7e781c-f56a-471f-8646-7ef7b1056317" status: 202 len: 0 microversion: 2.1 time: 0.181494 Aug 04 22:32:26.814206 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 551/1093] 10.222.0.109 () {58 vars in 1421 bytes} [Thu Aug 4 22:32:26 2022] DELETE /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/os-volume_attachments/1c7e781c-f56a-471f-8646-7ef7b1056317 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:32:26.823463 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3700a330-e5a7-4c90-bbb2-06f69a544ae8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:26.825836 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3700a330-e5a7-4c90-bbb2-06f69a544ae8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:26.832338 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3700a330-e5a7-4c90-bbb2-06f69a544ae8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:26.832830 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3700a330-e5a7-4c90-bbb2-06f69a544ae8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:26.833303 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3700a330-e5a7-4c90-bbb2-06f69a544ae8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:26.834063 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3700a330-e5a7-4c90-bbb2-06f69a544ae8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:26.834522 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3700a330-e5a7-4c90-bbb2-06f69a544ae8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:26.834958 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3700a330-e5a7-4c90-bbb2-06f69a544ae8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:26.867052 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3700a330-e5a7-4c90-bbb2-06f69a544ae8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048163 Aug 04 22:32:26.867883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 543/1094] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:32:26 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:32:27.353511 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a7ddcc12-072f-4ab2-86a9-895e7028c04b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:32:27.360379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7ddcc12-072f-4ab2-86a9-895e7028c04b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:27.360864 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7ddcc12-072f-4ab2-86a9-895e7028c04b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:27.361298 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7ddcc12-072f-4ab2-86a9-895e7028c04b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:27.383879 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a7ddcc12-072f-4ab2-86a9-895e7028c04b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Going to try to stop instance {{(pid=129196) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 22:32:27.427307 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a7ddcc12-072f-4ab2-86a9-895e7028c04b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "POST /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/action" status: 202 len: 0 microversion: 2.1 time: 0.078254 Aug 04 22:32:27.427931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 552/1095] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:32:27 2022] POST /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:32:27.435955 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2a95a77c-237c-461a-a673-8ab6bc97d134 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:27.436568 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2a95a77c-237c-461a-a673-8ab6bc97d134 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:27.442672 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2a95a77c-237c-461a-a673-8ab6bc97d134 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:27.443162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2a95a77c-237c-461a-a673-8ab6bc97d134 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:27.443718 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2a95a77c-237c-461a-a673-8ab6bc97d134 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:27.444414 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2a95a77c-237c-461a-a673-8ab6bc97d134 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:27.444882 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2a95a77c-237c-461a-a673-8ab6bc97d134 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:27.445487 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2a95a77c-237c-461a-a673-8ab6bc97d134 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:27.592596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2a95a77c-237c-461a-a673-8ab6bc97d134 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:27.601864 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2a95a77c-237c-461a-a673-8ab6bc97d134 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1681 microversion: 2.1 time: 0.169570 Aug 04 22:32:27.602444 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 544/1096] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:27 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:27.881561 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7651894e-3d5e-4c0b-b473-85c091e10e09 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:27.883856 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7651894e-3d5e-4c0b-b473-85c091e10e09 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:27.889973 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7651894e-3d5e-4c0b-b473-85c091e10e09 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:27.890758 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7651894e-3d5e-4c0b-b473-85c091e10e09 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:27.891200 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7651894e-3d5e-4c0b-b473-85c091e10e09 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:27.891880 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7651894e-3d5e-4c0b-b473-85c091e10e09 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:27.892328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7651894e-3d5e-4c0b-b473-85c091e10e09 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:27.892745 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7651894e-3d5e-4c0b-b473-85c091e10e09 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:27.923559 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7651894e-3d5e-4c0b-b473-85c091e10e09 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046735 Aug 04 22:32:27.924123 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 553/1097] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:32:27 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:32:28.623519 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-79c25a4c-bbe4-4353-9a9f-91e8b1dce104 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:28.624770 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-79c25a4c-bbe4-4353-9a9f-91e8b1dce104 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:28.631609 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-79c25a4c-bbe4-4353-9a9f-91e8b1dce104 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:28.632101 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-79c25a4c-bbe4-4353-9a9f-91e8b1dce104 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:28.632543 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-79c25a4c-bbe4-4353-9a9f-91e8b1dce104 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:28.633245 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-79c25a4c-bbe4-4353-9a9f-91e8b1dce104 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:28.633731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-79c25a4c-bbe4-4353-9a9f-91e8b1dce104 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:28.634164 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-79c25a4c-bbe4-4353-9a9f-91e8b1dce104 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:28.769390 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-79c25a4c-bbe4-4353-9a9f-91e8b1dce104 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:28.777017 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-79c25a4c-bbe4-4353-9a9f-91e8b1dce104 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1681 microversion: 2.1 time: 0.157380 Aug 04 22:32:28.777601 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 545/1098] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:28 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:28.935614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5ae48a48-4cd0-44f9-980a-a811953941de tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:28.938014 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5ae48a48-4cd0-44f9-980a-a811953941de tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:28.944503 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5ae48a48-4cd0-44f9-980a-a811953941de tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:28.944988 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5ae48a48-4cd0-44f9-980a-a811953941de tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:28.945449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5ae48a48-4cd0-44f9-980a-a811953941de tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:28.946144 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5ae48a48-4cd0-44f9-980a-a811953941de tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:28.946600 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5ae48a48-4cd0-44f9-980a-a811953941de tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:28.947029 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5ae48a48-4cd0-44f9-980a-a811953941de tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:28.977958 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5ae48a48-4cd0-44f9-980a-a811953941de tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046157 Aug 04 22:32:28.978526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 554/1099] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:32:28 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 22:32:29.046956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4043e9f3-4ff3-43c7-8a80-a8a5574d7ea0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:29.047597 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4043e9f3-4ff3-43c7-8a80-a8a5574d7ea0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:29.054539 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4043e9f3-4ff3-43c7-8a80-a8a5574d7ea0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:29.056233 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4043e9f3-4ff3-43c7-8a80-a8a5574d7ea0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:29.056670 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4043e9f3-4ff3-43c7-8a80-a8a5574d7ea0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:29.057395 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4043e9f3-4ff3-43c7-8a80-a8a5574d7ea0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:29.057866 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4043e9f3-4ff3-43c7-8a80-a8a5574d7ea0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:29.058474 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4043e9f3-4ff3-43c7-8a80-a8a5574d7ea0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:29.086971 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4043e9f3-4ff3-43c7-8a80-a8a5574d7ea0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Going to try to terminate instance {{(pid=129197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:32:29.164314 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4043e9f3-4ff3-43c7-8a80-a8a5574d7ea0 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 204 len: 0 microversion: 2.1 time: 0.121396 Aug 04 22:32:29.164824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 546/1100] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:32:29 2022] DELETE /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:32:29.173620 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8423b9a6-a61e-4cd3-8fdb-b6e77466793b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:29.174238 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8423b9a6-a61e-4cd3-8fdb-b6e77466793b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:29.180150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8423b9a6-a61e-4cd3-8fdb-b6e77466793b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:29.180632 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8423b9a6-a61e-4cd3-8fdb-b6e77466793b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:29.181071 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8423b9a6-a61e-4cd3-8fdb-b6e77466793b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:29.181794 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8423b9a6-a61e-4cd3-8fdb-b6e77466793b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:29.182247 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8423b9a6-a61e-4cd3-8fdb-b6e77466793b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:29.182674 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8423b9a6-a61e-4cd3-8fdb-b6e77466793b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:29.318065 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8423b9a6-a61e-4cd3-8fdb-b6e77466793b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:29.325632 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8423b9a6-a61e-4cd3-8fdb-b6e77466793b tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1687 microversion: 2.1 time: 0.156566 Aug 04 22:32:29.326197 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 555/1101] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:29 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:29.798691 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1ac91ca8-bff6-422c-95d2-cb67104b2e59 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:29.799381 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1ac91ca8-bff6-422c-95d2-cb67104b2e59 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:29.805805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1ac91ca8-bff6-422c-95d2-cb67104b2e59 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:29.806292 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1ac91ca8-bff6-422c-95d2-cb67104b2e59 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:29.806719 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1ac91ca8-bff6-422c-95d2-cb67104b2e59 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:29.807400 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1ac91ca8-bff6-422c-95d2-cb67104b2e59 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:29.807849 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1ac91ca8-bff6-422c-95d2-cb67104b2e59 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:29.808266 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1ac91ca8-bff6-422c-95d2-cb67104b2e59 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:29.945730 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1ac91ca8-bff6-422c-95d2-cb67104b2e59 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:29.955218 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1ac91ca8-bff6-422c-95d2-cb67104b2e59 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1681 microversion: 2.1 time: 0.160676 Aug 04 22:32:29.956097 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 547/1102] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:29 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:30.347541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-cdea5dfa-f1ea-4b81-96ed-725c913dd8cf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:30.348161 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-cdea5dfa-f1ea-4b81-96ed-725c913dd8cf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:30.354682 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cdea5dfa-f1ea-4b81-96ed-725c913dd8cf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:30.355175 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cdea5dfa-f1ea-4b81-96ed-725c913dd8cf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:30.355612 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cdea5dfa-f1ea-4b81-96ed-725c913dd8cf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:30.356308 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cdea5dfa-f1ea-4b81-96ed-725c913dd8cf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:30.356765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cdea5dfa-f1ea-4b81-96ed-725c913dd8cf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:30.357194 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-cdea5dfa-f1ea-4b81-96ed-725c913dd8cf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:30.489268 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-cdea5dfa-f1ea-4b81-96ed-725c913dd8cf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:30.496721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-cdea5dfa-f1ea-4b81-96ed-725c913dd8cf tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1687 microversion: 2.1 time: 0.153282 Aug 04 22:32:30.497283 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 556/1103] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:30 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:30.976916 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-78ef8f52-e7ad-426c-8878-736460d517cd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:30.977643 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-78ef8f52-e7ad-426c-8878-736460d517cd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:30.984182 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78ef8f52-e7ad-426c-8878-736460d517cd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:30.984667 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78ef8f52-e7ad-426c-8878-736460d517cd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:30.985100 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78ef8f52-e7ad-426c-8878-736460d517cd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:30.985810 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78ef8f52-e7ad-426c-8878-736460d517cd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:30.986259 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78ef8f52-e7ad-426c-8878-736460d517cd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:30.986676 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78ef8f52-e7ad-426c-8878-736460d517cd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:31.116724 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-78ef8f52-e7ad-426c-8878-736460d517cd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:31.125053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-78ef8f52-e7ad-426c-8878-736460d517cd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1681 microversion: 2.1 time: 0.151684 Aug 04 22:32:31.125654 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 548/1104] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:30 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:31.517845 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e42f087c-7dd0-40a2-b074-2003b3b1dc49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:31.518462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e42f087c-7dd0-40a2-b074-2003b3b1dc49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:31.524913 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e42f087c-7dd0-40a2-b074-2003b3b1dc49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:31.525392 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e42f087c-7dd0-40a2-b074-2003b3b1dc49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:31.525855 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e42f087c-7dd0-40a2-b074-2003b3b1dc49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:31.526544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e42f087c-7dd0-40a2-b074-2003b3b1dc49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:31.526998 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e42f087c-7dd0-40a2-b074-2003b3b1dc49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:31.527422 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e42f087c-7dd0-40a2-b074-2003b3b1dc49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:31.655903 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e42f087c-7dd0-40a2-b074-2003b3b1dc49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:31.663364 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e42f087c-7dd0-40a2-b074-2003b3b1dc49 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1687 microversion: 2.1 time: 0.150008 Aug 04 22:32:31.663934 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 557/1105] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:31 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:32.146827 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1cc4266b-6556-429c-8df6-abef26b10123 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:32.147441 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1cc4266b-6556-429c-8df6-abef26b10123 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:32.153781 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1cc4266b-6556-429c-8df6-abef26b10123 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:32.154257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1cc4266b-6556-429c-8df6-abef26b10123 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:32.154691 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1cc4266b-6556-429c-8df6-abef26b10123 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:32.155375 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1cc4266b-6556-429c-8df6-abef26b10123 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:32.155825 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1cc4266b-6556-429c-8df6-abef26b10123 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:32.156426 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1cc4266b-6556-429c-8df6-abef26b10123 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:32.386818 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1cc4266b-6556-429c-8df6-abef26b10123 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:32.394617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1cc4266b-6556-429c-8df6-abef26b10123 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1681 microversion: 2.1 time: 0.251727 Aug 04 22:32:32.395290 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 549/1106] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:32 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:32.608268 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-46ea190b-497e-4798-99ae-7f17eea8f304 req-bbd3adcd-f865-410a-9628-9d7023175e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc7a7f9-fcbe-425c-9f91-5e6714f008c0", "name": "network-vif-deleted", "tag": "36b51b87-4d4b-46be-adab-47e6b1e54bfb"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:32:32.621228 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-46ea190b-497e-4798-99ae-7f17eea8f304 req-bbd3adcd-f865-410a-9628-9d7023175e90 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:32.621766 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-46ea190b-497e-4798-99ae-7f17eea8f304 req-bbd3adcd-f865-410a-9628-9d7023175e90 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:32.622334 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-46ea190b-497e-4798-99ae-7f17eea8f304 req-bbd3adcd-f865-410a-9628-9d7023175e90 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:32.635402 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-46ea190b-497e-4798-99ae-7f17eea8f304 req-bbd3adcd-f865-410a-9628-9d7023175e90 service nova] Creating event network-vif-deleted:36b51b87-4d4b-46be-adab-47e6b1e54bfb for instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 on hv-cinder-85221 Aug 04 22:32:32.643143 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-46ea190b-497e-4798-99ae-7f17eea8f304 req-bbd3adcd-f865-410a-9628-9d7023175e90 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037993 Aug 04 22:32:32.647105 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 558/1107] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:32:32.687307 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c4c47fd8-5043-4080-9d50-91f71790c5fc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:32.688343 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c4c47fd8-5043-4080-9d50-91f71790c5fc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:32.695405 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c4c47fd8-5043-4080-9d50-91f71790c5fc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:32.695947 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c4c47fd8-5043-4080-9d50-91f71790c5fc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:32.696381 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c4c47fd8-5043-4080-9d50-91f71790c5fc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:32.697129 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c4c47fd8-5043-4080-9d50-91f71790c5fc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:32.697617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c4c47fd8-5043-4080-9d50-91f71790c5fc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:32.698095 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c4c47fd8-5043-4080-9d50-91f71790c5fc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:32.788599 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c4c47fd8-5043-4080-9d50-91f71790c5fc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c50160e51b54cde9a3f617d71fbf1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011b296da6654fa38f76eadd7bebae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:32.798081 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c4c47fd8-5043-4080-9d50-91f71790c5fc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 200 len: 1331 microversion: 2.1 time: 0.117577 Aug 04 22:32:32.809433 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 550/1108] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:32 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:33.415822 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-932ebb92-0a60-4db9-9e07-4261af1bcb37 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:33.416521 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-932ebb92-0a60-4db9-9e07-4261af1bcb37 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:33.424620 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-932ebb92-0a60-4db9-9e07-4261af1bcb37 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:33.425125 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-932ebb92-0a60-4db9-9e07-4261af1bcb37 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:33.425607 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-932ebb92-0a60-4db9-9e07-4261af1bcb37 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:33.426325 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-932ebb92-0a60-4db9-9e07-4261af1bcb37 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:33.426788 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-932ebb92-0a60-4db9-9e07-4261af1bcb37 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:33.427312 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-932ebb92-0a60-4db9-9e07-4261af1bcb37 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:33.564653 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-932ebb92-0a60-4db9-9e07-4261af1bcb37 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:33.572322 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-932ebb92-0a60-4db9-9e07-4261af1bcb37 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1681 microversion: 2.1 time: 0.160712 Aug 04 22:32:33.572887 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 559/1109] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:33 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:33.822293 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4969046b-5262-43ae-8df6-7a5ccb884195 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:33.822883 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4969046b-5262-43ae-8df6-7a5ccb884195 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:33.829792 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4969046b-5262-43ae-8df6-7a5ccb884195 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:33.830276 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4969046b-5262-43ae-8df6-7a5ccb884195 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:33.830705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4969046b-5262-43ae-8df6-7a5ccb884195 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:33.831387 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4969046b-5262-43ae-8df6-7a5ccb884195 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:33.831838 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4969046b-5262-43ae-8df6-7a5ccb884195 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:33.832257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4969046b-5262-43ae-8df6-7a5ccb884195 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:33.846530 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-4969046b-5262-43ae-8df6-7a5ccb884195 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4969046b-5262-43ae-8df6-7a5ccb884195 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 HTTP/1.1 Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:32:33.848166 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:32:33.849855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:32:33.849855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:33.849855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:33.849855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:33.849855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:33.849855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:32:33.849855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:32:33.849855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:32:33.849855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:33.849855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:32:33.849855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:33.849855 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '9bc7a7f9-fcbe-425c-9f91-5e6714f008c0'} Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:32:33.850805 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:33.852329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:33.853740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4969046b-5262-43ae-8df6-7a5ccb884195 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 404 to user: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:32:33.853740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4969046b-5262-43ae-8df6-7a5ccb884195 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 404 len: 111 microversion: 2.1 time: 0.031141 Aug 04 22:32:33.853740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 551/1110] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:33 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:32:33.858765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-52dd8ae0-5a15-4df4-bb4b-6de219b79438 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '.version_select at 0x7fe7b2061550>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:33.876775 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-52dd8ae0-5a15-4df4-bb4b-6de219b79438 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131270065" status: 202 len: 0 microversion: 2.1 time: 0.021821 Aug 04 22:32:33.877330 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 560/1111] 10.222.0.109 () {58 vars in 1226 bytes} [Thu Aug 4 22:32:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131270065 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:32:34.594254 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c0f7ad28-db4a-4840-aaf9-b66c8eb5b40b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:34.594866 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c0f7ad28-db4a-4840-aaf9-b66c8eb5b40b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:34.600680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c0f7ad28-db4a-4840-aaf9-b66c8eb5b40b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:34.601161 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c0f7ad28-db4a-4840-aaf9-b66c8eb5b40b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:34.601637 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c0f7ad28-db4a-4840-aaf9-b66c8eb5b40b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:34.602322 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c0f7ad28-db4a-4840-aaf9-b66c8eb5b40b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:34.602771 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c0f7ad28-db4a-4840-aaf9-b66c8eb5b40b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:34.603191 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c0f7ad28-db4a-4840-aaf9-b66c8eb5b40b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:34.739665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c0f7ad28-db4a-4840-aaf9-b66c8eb5b40b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:34.748808 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c0f7ad28-db4a-4840-aaf9-b66c8eb5b40b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1681 microversion: 2.1 time: 0.159314 Aug 04 22:32:34.749652 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 552/1112] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:34 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:35.612194 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b9503d4d-8dd9-4636-8e77-63c6a47309e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:35.612694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b9503d4d-8dd9-4636-8e77-63c6a47309e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:35.619227 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b9503d4d-8dd9-4636-8e77-63c6a47309e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:35.619706 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b9503d4d-8dd9-4636-8e77-63c6a47309e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:35.620135 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b9503d4d-8dd9-4636-8e77-63c6a47309e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:35.620816 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b9503d4d-8dd9-4636-8e77-63c6a47309e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:35.621261 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b9503d4d-8dd9-4636-8e77-63c6a47309e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:35.621701 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b9503d4d-8dd9-4636-8e77-63c6a47309e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:35.635086 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-b9503d4d-8dd9-4636-8e77-63c6a47309e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b9503d4d-8dd9-4636-8e77-63c6a47309e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: DELETE /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 HTTP/1.1 Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:32:35.636715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:32:35.638365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:32:35.638365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:35.638365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:35.638365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:35.638365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:35.638365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:32:35.638365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:32:35.638365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:32:35.638365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:35.638365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:32:35.638365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:35.638365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': '9bc7a7f9-fcbe-425c-9f91-5e6714f008c0'} Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:32:35.639965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:35.641501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:35.642747 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b9503d4d-8dd9-4636-8e77-63c6a47309e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 404 to user: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:32:35.642747 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b9503d4d-8dd9-4636-8e77-63c6a47309e8 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 404 len: 111 microversion: 2.1 time: 0.030275 Aug 04 22:32:35.642747 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 561/1113] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:32:35 2022] DELETE /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:32:35.646935 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1f359af5-1df7-4906-a0b1-7f23df140f76 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:35.647560 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1f359af5-1df7-4906-a0b1-7f23df140f76 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:35.654065 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1f359af5-1df7-4906-a0b1-7f23df140f76 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:35.654548 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1f359af5-1df7-4906-a0b1-7f23df140f76 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:35.654979 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1f359af5-1df7-4906-a0b1-7f23df140f76 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:35.655671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1f359af5-1df7-4906-a0b1-7f23df140f76 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:35.656116 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1f359af5-1df7-4906-a0b1-7f23df140f76 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:35.656534 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1f359af5-1df7-4906-a0b1-7f23df140f76 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:35.669378 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-1f359af5-1df7-4906-a0b1-7f23df140f76 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1f359af5-1df7-4906-a0b1-7f23df140f76 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 HTTP/1.1 Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:32:35.670977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:32:35.672602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:32:35.672602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:35.672602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:35.672602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:35.672602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:35.672602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:32:35.672602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:32:35.672602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:32:35.672602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:35.672602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:32:35.672602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:35.672602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '9bc7a7f9-fcbe-425c-9f91-5e6714f008c0'} Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:32:35.673603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. Aug 04 22:32:35.675020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:35.676476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1f359af5-1df7-4906-a0b1-7f23df140f76 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 404 to user: Instance 9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:32:35.676476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1f359af5-1df7-4906-a0b1-7f23df140f76 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0" status: 404 len: 111 microversion: 2.1 time: 0.029577 Aug 04 22:32:35.676476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 553/1114] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:35 2022] GET /compute/v2.1/servers/9bc7a7f9-fcbe-425c-9f91-5e6714f008c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:32:35.774210 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c6980912-743e-4310-bfbe-9dc9f2e0abb9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:35.774818 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c6980912-743e-4310-bfbe-9dc9f2e0abb9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:35.780852 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c6980912-743e-4310-bfbe-9dc9f2e0abb9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:35.781354 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c6980912-743e-4310-bfbe-9dc9f2e0abb9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:35.781794 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c6980912-743e-4310-bfbe-9dc9f2e0abb9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:35.782489 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c6980912-743e-4310-bfbe-9dc9f2e0abb9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:35.782938 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c6980912-743e-4310-bfbe-9dc9f2e0abb9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:35.783355 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c6980912-743e-4310-bfbe-9dc9f2e0abb9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:35.910540 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c6980912-743e-4310-bfbe-9dc9f2e0abb9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:35.917886 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c6980912-743e-4310-bfbe-9dc9f2e0abb9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1681 microversion: 2.1 time: 0.147486 Aug 04 22:32:35.918445 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 562/1115] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:35 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:36.809220 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e9682771-90f5-427f-9112-621e408f6500 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:36.809776 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e9682771-90f5-427f-9112-621e408f6500 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:36.816326 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e9682771-90f5-427f-9112-621e408f6500 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:36.816804 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e9682771-90f5-427f-9112-621e408f6500 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:36.817235 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e9682771-90f5-427f-9112-621e408f6500 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:36.817953 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e9682771-90f5-427f-9112-621e408f6500 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:36.818402 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e9682771-90f5-427f-9112-621e408f6500 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:36.818820 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e9682771-90f5-427f-9112-621e408f6500 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:36.833064 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-e9682771-90f5-427f-9112-621e408f6500 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e9682771-90f5-427f-9112-621e408f6500 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: DELETE /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 HTTP/1.1 Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:32:36.834630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:32:36.836201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:32:36.836201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:36.836201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:36.836201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:36.836201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:36.836201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:32:36.836201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:32:36.836201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:32:36.836201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:36.836201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:32:36.836201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:32:36.836201 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': 'b5faeb98-3d13-42e3-ac27-274501489586'} Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:32:36.837124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:32:36.838711 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.840139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e9682771-90f5-427f-9112-621e408f6500 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 404 to user: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:32:36.840139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e9682771-90f5-427f-9112-621e408f6500 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 404 len: 111 microversion: 2.1 time: 0.030583 Aug 04 22:32:36.840139 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 554/1116] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:32:36 2022] DELETE /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:32:36.845446 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a7de3103-767c-42d0-802c-512700344703 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:36.846065 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a7de3103-767c-42d0-802c-512700344703 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b5faeb98-3d13-42e3-ac27-274501489586] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:36.852434 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7de3103-767c-42d0-802c-512700344703 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:36.852918 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7de3103-767c-42d0-802c-512700344703 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:36.853374 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7de3103-767c-42d0-802c-512700344703 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:36.854079 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7de3103-767c-42d0-802c-512700344703 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:36.854532 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7de3103-767c-42d0-802c-512700344703 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:36.854962 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7de3103-767c-42d0-802c-512700344703 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:36.868180 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-a7de3103-767c-42d0-802c-512700344703 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a7de3103-767c-42d0-802c-512700344703 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 HTTP/1.1 Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:32:36.869725 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:32:36.871271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:32:36.871271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:36.871271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:36.871271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:36.871271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:36.871271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:32:36.871271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:32:36.871271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:32:36.871271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:36.871271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:32:36.871271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:32:36.871271 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'b5faeb98-3d13-42e3-ac27-274501489586'} Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:32:36.874309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. Aug 04 22:32:36.875807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.877116 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a7de3103-767c-42d0-802c-512700344703 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 404 to user: Instance b5faeb98-3d13-42e3-ac27-274501489586 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:32:36.877116 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a7de3103-767c-42d0-802c-512700344703 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586" status: 404 len: 111 microversion: 2.1 time: 0.030532 Aug 04 22:32:36.877116 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 563/1117] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:36 2022] GET /compute/v2.1/servers/b5faeb98-3d13-42e3-ac27-274501489586 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:32:36.879708 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bec72306-1a07-45b6-869c-e20e1a102b51 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:36.880202 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bec72306-1a07-45b6-869c-e20e1a102b51 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:36.886076 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bec72306-1a07-45b6-869c-e20e1a102b51 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:36.886553 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bec72306-1a07-45b6-869c-e20e1a102b51 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:36.886984 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bec72306-1a07-45b6-869c-e20e1a102b51 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:36.887664 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bec72306-1a07-45b6-869c-e20e1a102b51 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:36.888114 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bec72306-1a07-45b6-869c-e20e1a102b51 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:36.888532 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bec72306-1a07-45b6-869c-e20e1a102b51 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:36.902107 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-bec72306-1a07-45b6-869c-e20e1a102b51 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bec72306-1a07-45b6-869c-e20e1a102b51 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: DELETE /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 HTTP/1.1 Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:32:36.903614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:32:36.905789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:32:36.905789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:36.905789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:36.905789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:36.905789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:36.905789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:32:36.905789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:32:36.905789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:32:36.905789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:36.905789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:32:36.905789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:32:36.905789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': 'b377be43-9cb6-4bf2-9702-a280d8cc51b9'} Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:32:36.906697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:32:36.908153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.909648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bec72306-1a07-45b6-869c-e20e1a102b51 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 404 to user: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:32:36.909648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bec72306-1a07-45b6-869c-e20e1a102b51 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 404 len: 111 microversion: 2.1 time: 0.029120 Aug 04 22:32:36.909648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 555/1118] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:32:36 2022] DELETE /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:32:36.913734 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-fe4466ed-ce37-4aca-a523-966321198882 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:36.914343 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-fe4466ed-ce37-4aca-a523-966321198882 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: b377be43-9cb6-4bf2-9702-a280d8cc51b9] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:36.920128 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe4466ed-ce37-4aca-a523-966321198882 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:36.921229 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe4466ed-ce37-4aca-a523-966321198882 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:36.921522 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe4466ed-ce37-4aca-a523-966321198882 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:36.922320 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe4466ed-ce37-4aca-a523-966321198882 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:36.922772 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe4466ed-ce37-4aca-a523-966321198882 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:36.923197 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fe4466ed-ce37-4aca-a523-966321198882 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:36.936948 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-fe4466ed-ce37-4aca-a523-966321198882 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-fe4466ed-ce37-4aca-a523-966321198882 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 HTTP/1.1 Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:32:36.938494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:32:36.940075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:32:36.940075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:36.940075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:36.940075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:36.940075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:36.940075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:32:36.940075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:32:36.940075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:32:36.940075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:36.940075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:32:36.940075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:32:36.940075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'b377be43-9cb6-4bf2-9702-a280d8cc51b9'} Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:32:36.941147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. Aug 04 22:32:36.943148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:36.945074 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-214d98d1-9354-43ec-888d-d649db9f8404 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:36.945192 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-fe4466ed-ce37-4aca-a523-966321198882 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 404 to user: Instance b377be43-9cb6-4bf2-9702-a280d8cc51b9 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:32:36.945306 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-214d98d1-9354-43ec-888d-d649db9f8404 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:36.945428 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-fe4466ed-ce37-4aca-a523-966321198882 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9" status: 404 len: 111 microversion: 2.1 time: 0.029812 Aug 04 22:32:36.945428 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 564/1119] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:36 2022] GET /compute/v2.1/servers/b377be43-9cb6-4bf2-9702-a280d8cc51b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:32:36.946477 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-214d98d1-9354-43ec-888d-d649db9f8404 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:36.946649 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-214d98d1-9354-43ec-888d-d649db9f8404 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:36.947212 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-214d98d1-9354-43ec-888d-d649db9f8404 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:36.947921 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-214d98d1-9354-43ec-888d-d649db9f8404 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:36.948394 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-214d98d1-9354-43ec-888d-d649db9f8404 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:36.948793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-214d98d1-9354-43ec-888d-d649db9f8404 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:37.088946 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-214d98d1-9354-43ec-888d-d649db9f8404 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:37.098045 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-214d98d1-9354-43ec-888d-d649db9f8404 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1681 microversion: 2.1 time: 0.163333 Aug 04 22:32:37.098616 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 556/1120] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:36 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:32:38.089352 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3a90e191-4980-4d12-8399-fa648aa19351 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:38.089925 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3a90e191-4980-4d12-8399-fa648aa19351 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:38.097064 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3a90e191-4980-4d12-8399-fa648aa19351 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:38.097579 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3a90e191-4980-4d12-8399-fa648aa19351 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:38.098012 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3a90e191-4980-4d12-8399-fa648aa19351 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:38.098698 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3a90e191-4980-4d12-8399-fa648aa19351 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:38.099144 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3a90e191-4980-4d12-8399-fa648aa19351 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:38.099567 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3a90e191-4980-4d12-8399-fa648aa19351 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:38.116098 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-3a90e191-4980-4d12-8399-fa648aa19351 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3a90e191-4980-4d12-8399-fa648aa19351 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: DELETE /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 HTTP/1.1 Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:32:38.117708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:32:38.119401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:32:38.119401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:38.119401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:38.119401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:38.119401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:38.119401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:32:38.119401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:32:38.119401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:32:38.119401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:38.119401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:32:38.119401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:32:38.119401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'a9533fa0-d1ed-4df8-9a1f-d754b79c5394'} Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:32:38.120201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:32:38.121449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:38.122861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3a90e191-4980-4d12-8399-fa648aa19351 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 404 to user: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:32:38.122861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3a90e191-4980-4d12-8399-fa648aa19351 tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "DELETE /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 404 len: 111 microversion: 2.1 time: 0.033813 Aug 04 22:32:38.123031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-36193cee-8574-4193-bd3c-4c504cddef94 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:38.123437 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 565/1121] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:32:38 2022] DELETE /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:32:38.123595 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-36193cee-8574-4193-bd3c-4c504cddef94 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:38.127129 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36193cee-8574-4193-bd3c-4c504cddef94 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:38.127624 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36193cee-8574-4193-bd3c-4c504cddef94 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:38.127849 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-818bae40-c861-40af-92d5-4cdfc776aecc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:38.128068 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36193cee-8574-4193-bd3c-4c504cddef94 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:38.128462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-818bae40-c861-40af-92d5-4cdfc776aecc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] [instance: a9533fa0-d1ed-4df8-9a1f-d754b79c5394] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:38.128776 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36193cee-8574-4193-bd3c-4c504cddef94 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:38.129237 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36193cee-8574-4193-bd3c-4c504cddef94 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:38.129703 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-36193cee-8574-4193-bd3c-4c504cddef94 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:38.134327 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-818bae40-c861-40af-92d5-4cdfc776aecc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:38.134812 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-818bae40-c861-40af-92d5-4cdfc776aecc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:38.135245 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-818bae40-c861-40af-92d5-4cdfc776aecc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:38.135934 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-818bae40-c861-40af-92d5-4cdfc776aecc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:38.136409 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-818bae40-c861-40af-92d5-4cdfc776aecc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:38.136833 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-818bae40-c861-40af-92d5-4cdfc776aecc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:38.150229 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-818bae40-c861-40af-92d5-4cdfc776aecc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] HTTP exception thrown: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-818bae40-c861-40af-92d5-4cdfc776aecc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Request method failure captured: Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 HTTP/1.1 Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EYsvvYw1bxzI3cK28qdsPq4SIaYAPTgZE-IiWzq1oenPVovnTwVvXI-0uIhDTc3zok1--SU8cDe5b4r-D_QuqNtqTJE71xAm-CxBcug6hyha4s9zR6OW0xJF9AAqo065J8ppOwxV9OME2uvLJzBgd_I-Iie03VY92i9gvZMgUsFous Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:32:38.151750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:32:38.153328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_011b296da6654fa38f76eadd7bebae6f", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/011b296da6654fa38f76eadd7bebae6f"}]}] Aug 04 22:32:38.153328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:38.153328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 011b296da6654fa38f76eadd7bebae6f Aug 04 22:32:38.153328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651683156 Aug 04 22:32:38.153328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:38.153328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:32:38.153328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:32:38.153328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 8c50160e51b54cde9a3f617d71fbf1c0 Aug 04 22:32:38.153328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeNegativeTest-651683156-project Aug 04 22:32:38.153328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:32:38.153328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:32:38.153328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'a9533fa0-d1ed-4df8-9a1f-d754b79c5394'} Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:32:38.158259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. Aug 04 22:32:38.159795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:32:38.161605 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-818bae40-c861-40af-92d5-4cdfc776aecc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] Returning 404 to user: Instance a9533fa0-d1ed-4df8-9a1f-d754b79c5394 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:32:38.161605 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-818bae40-c861-40af-92d5-4cdfc776aecc tempest-AttachVolumeNegativeTest-651683156 tempest-AttachVolumeNegativeTest-651683156-project] 10.222.0.109 "GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394" status: 404 len: 111 microversion: 2.1 time: 0.029492 Aug 04 22:32:38.161605 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 566/1122] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:38 2022] GET /compute/v2.1/servers/a9533fa0-d1ed-4df8-9a1f-d754b79c5394 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:32:38.261157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-36193cee-8574-4193-bd3c-4c504cddef94 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:38.270100 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-36193cee-8574-4193-bd3c-4c504cddef94 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1658 microversion: 2.1 time: 0.154262 Aug 04 22:32:38.270617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 557/1123] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:38 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1658 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:32:38.290705 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-107c7a4a-c269-420c-9e59-f9f994cc7c6a tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:32:38.296608 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-107c7a4a-c269-420c-9e59-f9f994cc7c6a tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:38.297088 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-107c7a4a-c269-420c-9e59-f9f994cc7c6a tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:38.297549 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-107c7a4a-c269-420c-9e59-f9f994cc7c6a tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:38.321173 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-107c7a4a-c269-420c-9e59-f9f994cc7c6a tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Going to try to start instance {{(pid=129196) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 22:32:38.348743 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:32:38.374085 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-107c7a4a-c269-420c-9e59-f9f994cc7c6a tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "POST /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/action" status: 202 len: 0 microversion: 2.1 time: 0.086897 Aug 04 22:32:38.374953 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 567/1124] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:32:38 2022] POST /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:32:38.383176 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b039afa9-0111-413c-96ac-f3180b10a2e2 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:38.383884 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b039afa9-0111-413c-96ac-f3180b10a2e2 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:38.391208 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b039afa9-0111-413c-96ac-f3180b10a2e2 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:38.391837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b039afa9-0111-413c-96ac-f3180b10a2e2 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:38.392517 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b039afa9-0111-413c-96ac-f3180b10a2e2 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:38.393297 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b039afa9-0111-413c-96ac-f3180b10a2e2 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:38.394053 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b039afa9-0111-413c-96ac-f3180b10a2e2 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:38.394485 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b039afa9-0111-413c-96ac-f3180b10a2e2 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:38.398954 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:32:38.574304 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b039afa9-0111-413c-96ac-f3180b10a2e2 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:38.583030 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b039afa9-0111-413c-96ac-f3180b10a2e2 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1667 microversion: 2.1 time: 0.203626 Aug 04 22:32:38.589529 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 558/1125] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:38 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1667 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:39.607203 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-2bdb688f-520c-4118-ab77-b8ecd2bf5574 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:39.607807 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-2bdb688f-520c-4118-ab77-b8ecd2bf5574 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:39.614552 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2bdb688f-520c-4118-ab77-b8ecd2bf5574 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:39.615046 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2bdb688f-520c-4118-ab77-b8ecd2bf5574 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:39.615459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2bdb688f-520c-4118-ab77-b8ecd2bf5574 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:39.616150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2bdb688f-520c-4118-ab77-b8ecd2bf5574 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:39.616596 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2bdb688f-520c-4118-ab77-b8ecd2bf5574 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:39.617014 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2bdb688f-520c-4118-ab77-b8ecd2bf5574 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:39.766819 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2bdb688f-520c-4118-ab77-b8ecd2bf5574 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:39.774888 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-2bdb688f-520c-4118-ab77-b8ecd2bf5574 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1667 microversion: 2.1 time: 0.172591 Aug 04 22:32:39.781780 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 568/1126] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:39 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1667 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:32:40.799982 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d70c7134-d4d1-4b0e-ae44-417f60255730 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:32:40.800585 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d70c7134-d4d1-4b0e-ae44-417f60255730 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:32:40.809239 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d70c7134-d4d1-4b0e-ae44-417f60255730 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:40.812951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d70c7134-d4d1-4b0e-ae44-417f60255730 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:40.813929 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d70c7134-d4d1-4b0e-ae44-417f60255730 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:40.815145 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d70c7134-d4d1-4b0e-ae44-417f60255730 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:32:40.815921 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d70c7134-d4d1-4b0e-ae44-417f60255730 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:32:40.816748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d70c7134-d4d1-4b0e-ae44-417f60255730 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:32:41.069742 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d70c7134-d4d1-4b0e-ae44-417f60255730 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:32:41.078338 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d70c7134-d4d1-4b0e-ae44-417f60255730 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1671 microversion: 2.1 time: 0.284353 Aug 04 22:32:41.079111 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 559/1127] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:32:40 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1671 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:16.648909 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-03e8a672-7123-440f-a062-1819a58fef2b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:16.649432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-03e8a672-7123-440f-a062-1819a58fef2b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:16.655142 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-9353b142-c34f-457b-b4d6-06a375ed4e36 req-c9e97708-debc-4698-b483-ae2508beed89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd73ce87-41fe-4b81-9b4b-546962f70b2d", "tag": "568a695a-e288-47b9-b51b-cc0981c71810"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:33:16.661333 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:16.661564 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:16.662215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=10 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:16.662399 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=7,nova_cell1:INSERT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:16.664602 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03e8a672-7123-440f-a062-1819a58fef2b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:16.665121 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03e8a672-7123-440f-a062-1819a58fef2b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:16.665522 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03e8a672-7123-440f-a062-1819a58fef2b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:16.666337 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03e8a672-7123-440f-a062-1819a58fef2b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:16.666846 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03e8a672-7123-440f-a062-1819a58fef2b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:16.667500 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-03e8a672-7123-440f-a062-1819a58fef2b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:16.667622 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-9353b142-c34f-457b-b4d6-06a375ed4e36 req-c9e97708-debc-4698-b483-ae2508beed89 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:16.667857 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-9353b142-c34f-457b-b4d6-06a375ed4e36 req-c9e97708-debc-4698-b483-ae2508beed89 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:16.669103 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-9353b142-c34f-457b-b4d6-06a375ed4e36 req-c9e97708-debc-4698-b483-ae2508beed89 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:16.682695 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-9353b142-c34f-457b-b4d6-06a375ed4e36 req-c9e97708-debc-4698-b483-ae2508beed89 service nova] Creating event network-changed:568a695a-e288-47b9-b51b-cc0981c71810 for instance fd73ce87-41fe-4b81-9b4b-546962f70b2d on hv-cinder-85221 Aug 04 22:33:16.688707 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-9353b142-c34f-457b-b4d6-06a375ed4e36 req-c9e97708-debc-4698-b483-ae2508beed89 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038028 Aug 04 22:33:16.689964 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 560/1128] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:33:16.695696 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-03e8a672-7123-440f-a062-1819a58fef2b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Going to try to terminate instance {{(pid=129196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:33:16.787862 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-03e8a672-7123-440f-a062-1819a58fef2b tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "DELETE /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 204 len: 0 microversion: 2.1 time: 0.142838 Aug 04 22:33:16.788362 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 569/1129] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:33:16 2022] DELETE /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:33:16.797980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c98e0492-0b31-4024-b61e-31bbfa7a7bf3 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:16.798676 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c98e0492-0b31-4024-b61e-31bbfa7a7bf3 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:16.804958 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c98e0492-0b31-4024-b61e-31bbfa7a7bf3 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:16.805482 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c98e0492-0b31-4024-b61e-31bbfa7a7bf3 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:16.805916 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c98e0492-0b31-4024-b61e-31bbfa7a7bf3 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:16.806610 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c98e0492-0b31-4024-b61e-31bbfa7a7bf3 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:16.807077 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c98e0492-0b31-4024-b61e-31bbfa7a7bf3 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:16.807482 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c98e0492-0b31-4024-b61e-31bbfa7a7bf3 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:16.942980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c98e0492-0b31-4024-b61e-31bbfa7a7bf3 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:16.951128 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c98e0492-0b31-4024-b61e-31bbfa7a7bf3 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.158174 Aug 04 22:33:16.951692 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 561/1130] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:16 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:33:17.974947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0c3594ba-033a-4752-8481-94de3827850f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:17.975653 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0c3594ba-033a-4752-8481-94de3827850f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:17.982507 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0c3594ba-033a-4752-8481-94de3827850f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:17.982993 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0c3594ba-033a-4752-8481-94de3827850f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:17.983433 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0c3594ba-033a-4752-8481-94de3827850f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:17.984133 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0c3594ba-033a-4752-8481-94de3827850f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:17.984589 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0c3594ba-033a-4752-8481-94de3827850f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:17.985012 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0c3594ba-033a-4752-8481-94de3827850f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:18.120309 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0c3594ba-033a-4752-8481-94de3827850f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:18.128682 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0c3594ba-033a-4752-8481-94de3827850f tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1573 microversion: 2.1 time: 0.157933 Aug 04 22:33:18.129252 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 570/1131] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:17 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:19.150599 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4b5044a7-3c73-47d7-97c9-6df7758a1a83 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:19.151955 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4b5044a7-3c73-47d7-97c9-6df7758a1a83 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:19.159722 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5044a7-3c73-47d7-97c9-6df7758a1a83 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:19.160058 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5044a7-3c73-47d7-97c9-6df7758a1a83 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:19.160487 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5044a7-3c73-47d7-97c9-6df7758a1a83 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:19.161178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5044a7-3c73-47d7-97c9-6df7758a1a83 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:19.161737 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5044a7-3c73-47d7-97c9-6df7758a1a83 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:19.162160 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4b5044a7-3c73-47d7-97c9-6df7758a1a83 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:19.236382 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4b5044a7-3c73-47d7-97c9-6df7758a1a83 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:19.245516 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4b5044a7-3c73-47d7-97c9-6df7758a1a83 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1387 microversion: 2.1 time: 0.098776 Aug 04 22:33:19.260258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 562/1132] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:19 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:19.296899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-41eb81f6-8ae0-46f4-9563-024487f3e5ba req-09ebcbc3-a9a9-4584-8bbc-48949e0c835f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd73ce87-41fe-4b81-9b4b-546962f70b2d", "name": "network-vif-deleted", "tag": "568a695a-e288-47b9-b51b-cc0981c71810"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:33:19.306205 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-41eb81f6-8ae0-46f4-9563-024487f3e5ba req-09ebcbc3-a9a9-4584-8bbc-48949e0c835f service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:19.306669 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-41eb81f6-8ae0-46f4-9563-024487f3e5ba req-09ebcbc3-a9a9-4584-8bbc-48949e0c835f service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:19.307090 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-41eb81f6-8ae0-46f4-9563-024487f3e5ba req-09ebcbc3-a9a9-4584-8bbc-48949e0c835f service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:19.318179 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-41eb81f6-8ae0-46f4-9563-024487f3e5ba req-09ebcbc3-a9a9-4584-8bbc-48949e0c835f service nova] Creating event network-vif-deleted:568a695a-e288-47b9-b51b-cc0981c71810 for instance fd73ce87-41fe-4b81-9b4b-546962f70b2d on hv-cinder-85221 Aug 04 22:33:19.322764 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-41eb81f6-8ae0-46f4-9563-024487f3e5ba req-09ebcbc3-a9a9-4584-8bbc-48949e0c835f service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159740 Aug 04 22:33:19.323328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 571/1133] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:33:20.267992 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:20.268618 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:20.275615 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:20.276110 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:20.276548 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:20.277320 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:20.278458 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:20.278898 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:20.313469 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:20.313954 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:20.314395 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:20.314830 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.objects.instance [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lazy-loading 'fault' on Instance uuid fd73ce87-41fe-4b81-9b4b-546962f70b2d {{(pid=129197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:33:20.360637 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa106f1923b43dcb4ca4973815108c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff3367439f45a7b7a420b66dd8574a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:20.368699 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-54afcb89-b4d9-44a6-9bff-c4d4c96f352c tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 200 len: 1228 microversion: 2.1 time: 0.104685 Aug 04 22:33:20.369786 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 563/1134] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:20 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 1228 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:21.393778 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a9d34de2-2b35-4c9f-8cd5-69110cc2c699 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:21.394471 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a9d34de2-2b35-4c9f-8cd5-69110cc2c699 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [instance: fd73ce87-41fe-4b81-9b4b-546962f70b2d] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:21.400562 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a9d34de2-2b35-4c9f-8cd5-69110cc2c699 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:21.401035 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a9d34de2-2b35-4c9f-8cd5-69110cc2c699 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:21.401485 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a9d34de2-2b35-4c9f-8cd5-69110cc2c699 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:21.402165 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a9d34de2-2b35-4c9f-8cd5-69110cc2c699 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:21.402853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a9d34de2-2b35-4c9f-8cd5-69110cc2c699 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:21.403084 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a9d34de2-2b35-4c9f-8cd5-69110cc2c699 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:21.415938 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-a9d34de2-2b35-4c9f-8cd5-69110cc2c699 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] HTTP exception thrown: Instance fd73ce87-41fe-4b81-9b4b-546962f70b2d could not be found. Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a9d34de2-2b35-4c9f-8cd5-69110cc2c699 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Request method failure captured: Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d HTTP/1.1 Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EfgJ0tYCbnwN3AlgiRB8W4hIRfbrX7HM_Tmi0KzyOiNeTKY9rPv1VRqGBEnnvsB2fTLRnCskDlUD7wuHCc--rJrdA9owAjZnC2AJhEcAAsQFoYmIt4SGr-blmDiyq_vtUrJlXAGsDsSnsAeDn1QeyS9U30QxNTXlwI1eYluUM34NIM Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 5bff3367439f45a7b7a420b66dd8574a Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-TestShelveInstance-1023800920 Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:33:21.417544 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:33:21.420145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/5bff3367439f45a7b7a420b66dd8574a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_5bff3367439f45a7b7a420b66dd8574a", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/5bff3367439f45a7b7a420b66dd8574a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/5bff3367439f45a7b7a420b66dd8574a"}]}] Aug 04 22:33:21.420145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-TestShelveInstance-1023800920 Aug 04 22:33:21.420145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 5bff3367439f45a7b7a420b66dd8574a Aug 04 22:33:21.420145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-TestShelveInstance-1023800920 Aug 04 22:33:21.420145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-TestShelveInstance-1023800920-project Aug 04 22:33:21.420145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:33:21.420145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:33:21.420145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: aaa106f1923b43dcb4ca4973815108c0 Aug 04 22:33:21.420145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-TestShelveInstance-1023800920-project Aug 04 22:33:21.420145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:33:21.420145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance fd73ce87-41fe-4b81-9b4b-546962f70b2d could not be found. Aug 04 22:33:21.420145 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'fd73ce87-41fe-4b81-9b4b-546962f70b2d'} Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd73ce87-41fe-4b81-9b4b-546962f70b2d could not be found. Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:33:21.421166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd73ce87-41fe-4b81-9b4b-546962f70b2d could not be found. Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd73ce87-41fe-4b81-9b4b-546962f70b2d could not be found. Aug 04 22:33:21.422804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:33:21.424221 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a9d34de2-2b35-4c9f-8cd5-69110cc2c699 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Returning 404 to user: Instance fd73ce87-41fe-4b81-9b4b-546962f70b2d could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:33:21.424221 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a9d34de2-2b35-4c9f-8cd5-69110cc2c699 tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d" status: 404 len: 111 microversion: 2.1 time: 0.030347 Aug 04 22:33:21.424221 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 572/1135] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:21 2022] GET /compute/v2.1/servers/fd73ce87-41fe-4b81-9b4b-546962f70b2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:33:21.614761 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-fe79ad46-a489-445b-91b0-a011ac810bbd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] Calling method '.version_select at 0x7fe7b604ca60>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:21.619458 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fe79ad46-a489-445b-91b0-a011ac810bbd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [75aae9a9-a18d-4a44-a36f-beac2c320efa] AMQP server on 10.222.0.109:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 22:33:22.628083 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO oslo.messaging._drivers.impl_rabbit [None req-fe79ad46-a489-445b-91b0-a011ac810bbd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] [75aae9a9-a18d-4a44-a36f-beac2c320efa] Reconnected to AMQP server on 10.222.0.109:5672 via [amqp] client with port 35550. Aug 04 22:33:22.648291 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-fe79ad46-a489-445b-91b0-a011ac810bbd tempest-TestShelveInstance-1023800920 tempest-TestShelveInstance-1023800920-project] 10.222.0.109 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1619943125" status: 202 len: 0 microversion: 2.1 time: 1.037902 Aug 04 22:33:22.648951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 564/1136] 10.222.0.109 () {58 vars in 1259 bytes} [Thu Aug 4 22:33:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1619943125 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:33:43.895666 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:33:43.896240 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Thu Aug 4 22:33:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:33:44.314918 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-13430dce-9fc6-4c1e-8de7-f0af6314235d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:44.318008 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-13430dce-9fc6-4c1e-8de7-f0af6314235d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:44.320338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:44.321148 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:44.334765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-13430dce-9fc6-4c1e-8de7-f0af6314235d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:44.336147 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-13430dce-9fc6-4c1e-8de7-f0af6314235d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:44.336333 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-13430dce-9fc6-4c1e-8de7-f0af6314235d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:44.337350 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-13430dce-9fc6-4c1e-8de7-f0af6314235d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:44.338671 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-13430dce-9fc6-4c1e-8de7-f0af6314235d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:44.339346 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-13430dce-9fc6-4c1e-8de7-f0af6314235d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:44.390215 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-13430dce-9fc6-4c1e-8de7-f0af6314235d tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085067 Aug 04 22:33:44.398450 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 573/1137] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:33:44 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 22:33:44.476076 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=22 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:44.476841 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:44.486121 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d17260f6-04f1-4261-a81b-e434490c491f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:44.486677 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d17260f6-04f1-4261-a81b-e434490c491f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:44.495882 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d17260f6-04f1-4261-a81b-e434490c491f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:44.496391 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d17260f6-04f1-4261-a81b-e434490c491f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:44.496837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d17260f6-04f1-4261-a81b-e434490c491f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:44.497600 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d17260f6-04f1-4261-a81b-e434490c491f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:44.498236 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d17260f6-04f1-4261-a81b-e434490c491f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:44.498501 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d17260f6-04f1-4261-a81b-e434490c491f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:44.555959 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d17260f6-04f1-4261-a81b-e434490c491f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Going to try to terminate instance {{(pid=129197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:33:44.656849 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d17260f6-04f1-4261-a81b-e434490c491f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "DELETE /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 204 len: 0 microversion: 2.1 time: 0.182245 Aug 04 22:33:44.668736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-0ca59623-f8b9-4194-a69c-3aff4758dd87 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:44.670188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-0ca59623-f8b9-4194-a69c-3aff4758dd87 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:44.674490 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 565/1138] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:33:44 2022] DELETE /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:33:44.679714 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0ca59623-f8b9-4194-a69c-3aff4758dd87 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:44.680933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0ca59623-f8b9-4194-a69c-3aff4758dd87 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:44.680933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0ca59623-f8b9-4194-a69c-3aff4758dd87 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:44.682261 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0ca59623-f8b9-4194-a69c-3aff4758dd87 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:44.682947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0ca59623-f8b9-4194-a69c-3aff4758dd87 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:44.683618 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-0ca59623-f8b9-4194-a69c-3aff4758dd87 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:44.873690 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-0ca59623-f8b9-4194-a69c-3aff4758dd87 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:44.882248 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-0ca59623-f8b9-4194-a69c-3aff4758dd87 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1677 microversion: 2.1 time: 0.219775 Aug 04 22:33:44.882831 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 574/1139] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:44 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:45.001078 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-52ca0ab8-259f-45e1-b772-27db64930c63 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Action: 'create', calling method: .version_select at 0x7fe7b186fe50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1818150918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELfkn9X/jOdDImB+VwV2EI1tOcEOb3ijy7tP5O+hMrChNuCyV8QnVJstbaDG3iO2+qfK3WN8lR45V/1KLj7jnPm2dPrGcPN5LmumLee6y9hLibb3vVXrBqdoIZlAmSrfQ=="}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:33:45.021793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-52ca0ab8-259f-45e1-b772-27db64930c63 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Getting quotas for project 49576f2166cc4b7f9261bd7cbc8384f4. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:33:45.027082 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-52ca0ab8-259f-45e1-b772-27db64930c63 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Getting quotas for user 43e543cfa3e1402e9694dcb095a26c00 and project 49576f2166cc4b7f9261bd7cbc8384f4. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:33:45.049844 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-52ca0ab8-259f-45e1-b772-27db64930c63 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.237578 Aug 04 22:33:45.050663 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 566/1140] 10.222.0.109 () {60 vars in 1164 bytes} [Thu Aug 4 22:33:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:33:45.906019 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-dc26e117-e92d-4f3a-b658-6d93aed4095f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:45.906908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-dc26e117-e92d-4f3a-b658-6d93aed4095f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:45.915376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc26e117-e92d-4f3a-b658-6d93aed4095f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:45.918049 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc26e117-e92d-4f3a-b658-6d93aed4095f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:45.918612 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc26e117-e92d-4f3a-b658-6d93aed4095f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:45.919439 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc26e117-e92d-4f3a-b658-6d93aed4095f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:45.920154 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc26e117-e92d-4f3a-b658-6d93aed4095f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:45.920679 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc26e117-e92d-4f3a-b658-6d93aed4095f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:46.103922 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:33:46.106877 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Thu Aug 4 22:33:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 (ip 10.222.0.109) !!! Aug 04 22:33:46.112556 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-dc26e117-e92d-4f3a-b658-6d93aed4095f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:46.121868 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-dc26e117-e92d-4f3a-b658-6d93aed4095f tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1677 microversion: 2.1 time: 0.221476 Aug 04 22:33:46.127328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 575/1141] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:45 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:47.150015 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ceed596d-3efe-4117-9eb1-867f7684dabd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:47.152187 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ceed596d-3efe-4117-9eb1-867f7684dabd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:47.162742 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ceed596d-3efe-4117-9eb1-867f7684dabd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:47.163515 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ceed596d-3efe-4117-9eb1-867f7684dabd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:47.164674 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ceed596d-3efe-4117-9eb1-867f7684dabd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:47.165646 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ceed596d-3efe-4117-9eb1-867f7684dabd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:47.166296 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ceed596d-3efe-4117-9eb1-867f7684dabd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:47.167554 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ceed596d-3efe-4117-9eb1-867f7684dabd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:47.348583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ceed596d-3efe-4117-9eb1-867f7684dabd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:47.357113 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ceed596d-3efe-4117-9eb1-867f7684dabd tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1677 microversion: 2.1 time: 0.212660 Aug 04 22:33:47.369514 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 567/1142] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:47 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:47.921499 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-53834403-61c2-447a-843b-78b80d3ab0d4 req-7bbe6b20-d66c-411b-a69e-1d4d02964602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2baedf2f-2718-4cb2-a417-a230761f4002", "name": "network-vif-deleted", "tag": "6069b7b2-b1e6-49a7-a9a8-3edcfd6c9a60"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:33:47.936673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-53834403-61c2-447a-843b-78b80d3ab0d4 req-7bbe6b20-d66c-411b-a69e-1d4d02964602 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:47.937606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-53834403-61c2-447a-843b-78b80d3ab0d4 req-7bbe6b20-d66c-411b-a69e-1d4d02964602 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:47.938454 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-53834403-61c2-447a-843b-78b80d3ab0d4 req-7bbe6b20-d66c-411b-a69e-1d4d02964602 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:47.956530 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-53834403-61c2-447a-843b-78b80d3ab0d4 req-7bbe6b20-d66c-411b-a69e-1d4d02964602 service nova] Creating event network-vif-deleted:6069b7b2-b1e6-49a7-a9a8-3edcfd6c9a60 for instance 2baedf2f-2718-4cb2-a417-a230761f4002 on hv-cinder-85221 Aug 04 22:33:47.980315 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-53834403-61c2-447a-843b-78b80d3ab0d4 req-7bbe6b20-d66c-411b-a69e-1d4d02964602 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064121 Aug 04 22:33:47.982691 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 576/1143] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:33:48.379786 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:48.380489 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:48.387455 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:48.388297 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:48.388927 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:48.390072 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:48.390588 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:48.391216 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:48.426125 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:48.426856 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:48.427468 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:48.428063 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.objects.instance [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lazy-loading 'fault' on Instance uuid 2baedf2f-2718-4cb2-a417-a230761f4002 {{(pid=129197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:33:48.471978 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:48.479613 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-5059e947-3965-4b9f-b628-f0a88dc0c03b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 200 len: 1331 microversion: 2.1 time: 0.103944 Aug 04 22:33:48.480189 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 568/1144] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:48 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:49.500960 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1704e589-3bb4-4e78-b40a-05a0cb4392f0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:49.501809 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1704e589-3bb4-4e78-b40a-05a0cb4392f0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:49.508595 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1704e589-3bb4-4e78-b40a-05a0cb4392f0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:49.509081 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1704e589-3bb4-4e78-b40a-05a0cb4392f0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:49.510247 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1704e589-3bb4-4e78-b40a-05a0cb4392f0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:49.511037 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1704e589-3bb4-4e78-b40a-05a0cb4392f0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:49.511503 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1704e589-3bb4-4e78-b40a-05a0cb4392f0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:49.511962 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1704e589-3bb4-4e78-b40a-05a0cb4392f0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:49.526010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-1704e589-3bb4-4e78-b40a-05a0cb4392f0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] HTTP exception thrown: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1704e589-3bb4-4e78-b40a-05a0cb4392f0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Request method failure captured: Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 HTTP/1.1 Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EgqLFMVACCfMrY4J7ONHgYVvKlE4v1QQaBNNuJw33JDWgQa2db6oSCQWEEq_d_b3djeaziKxUdQ_9qQmAjT--Jhv1lA4NxTUfh9BHDtfniklooAXGTmTKdP-Y2X_3PJ23eoXVR642lr99fILTEz0z_dK9eEOKBdUHQzFw8agS4KWMI Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 477c661a08dd46b2a20f53a7944361ef Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:33:49.529654 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:33:49.531359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/477c661a08dd46b2a20f53a7944361ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_477c661a08dd46b2a20f53a7944361ef", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/477c661a08dd46b2a20f53a7944361ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/477c661a08dd46b2a20f53a7944361ef"}]}] Aug 04 22:33:49.531359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:33:49.531359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 477c661a08dd46b2a20f53a7944361ef Aug 04 22:33:49.531359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:33:49.531359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeTestJSON-2021858786-project Aug 04 22:33:49.531359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:33:49.531359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:33:49.531359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 890f3e80ae37401f8dad15d3d084f091 Aug 04 22:33:49.531359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeTestJSON-2021858786-project Aug 04 22:33:49.531359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:33:49.531359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:33:49.531359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': '2baedf2f-2718-4cb2-a417-a230761f4002'} Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:33:49.532349 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:33:49.533931 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:33:49.535376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1704e589-3bb4-4e78-b40a-05a0cb4392f0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Returning 404 to user: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:33:49.535376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1704e589-3bb4-4e78-b40a-05a0cb4392f0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 404 len: 111 microversion: 2.1 time: 0.034487 Aug 04 22:33:49.535376 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 577/1145] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:49 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:33:49.541914 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f85be5ce-fdb7-4a7f-973a-749e8ca8a689 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '.version_select at 0x7fe7b1778c10>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:49.561193 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f85be5ce-fdb7-4a7f-973a-749e8ca8a689 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1786916654" status: 202 len: 0 microversion: 2.1 time: 0.024642 Aug 04 22:33:49.561927 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 569/1146] 10.222.0.109 () {58 vars in 1226 bytes} [Thu Aug 4 22:33:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1786916654 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 22:33:50.215293 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-29c30943-c87b-48d3-8225-050370d0fd14 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Action: 'create', calling method: .version_select at 0x7fe7b20b4820>, body: {"keypair": {"name": "tempest-keypair-1571993974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUuCw/MFYq5fk63OtYbPUq9VHnGkH58dlMzSz86mfK4KDtWLblyiDeTaE95/LtowdXLe37wEEFHixQkk3mYCumT0Lb4wlTZWzzSIVBOckZ5Bs1uT30/6NJ3rmvYRF++XQ=="}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:33:50.231955 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-29c30943-c87b-48d3-8225-050370d0fd14 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Getting quotas for project 477c661a08dd46b2a20f53a7944361ef. Resources: {'key_pairs'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:33:50.236058 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-29c30943-c87b-48d3-8225-050370d0fd14 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Getting quotas for user 890f3e80ae37401f8dad15d3d084f091 and project 477c661a08dd46b2a20f53a7944361ef. Resources: {'key_pairs'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:33:50.259619 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-29c30943-c87b-48d3-8225-050370d0fd14 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048843 Aug 04 22:33:50.260742 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 578/1147] 10.222.0.109 () {60 vars in 1164 bytes} [Thu Aug 4 22:33:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:33:51.617673 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-448931628", "imageRef": "e3d6d977-4add-4d3a-80ea-880c8b2548a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28ae2b17-c5f1-41ff-82ff-0d99f599604c"}], "security_groups": [{"name": "tempest-securitygroup--876303654"}], "key_name": "tempest-keypair-1571993974", "user_data": "}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:33:51.722660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.network.neutron [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] validate_networks() for [('28ae2b17-c5f1-41ff-82ff-0d99f599604c', None, None, None, None, None)] {{(pid=129197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:33:52.212013 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Flavor limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:33:52.213339 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Image limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:33:52.213920 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Flavor pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:33:52.214350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Image pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:33:52.214761 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:33:52.223812 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:52.224309 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:52.224751 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:52.225614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:52.226262 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:52.226685 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:52.243447 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Getting quotas for project 477c661a08dd46b2a20f53a7944361ef. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:33:52.247571 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Getting quotas for user 890f3e80ae37401f8dad15d3d084f091 and project 477c661a08dd46b2a20f53a7944361ef. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:33:52.258984 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Going to run 1 instances... {{(pid=129197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:33:52.261997 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3d6d977-4add-4d3a-80ea-880c8b2548a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:33:52.310130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-78dfe90c-ccc5-448a-9d74-72d8a6ca957c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.697345 Aug 04 22:33:52.310767 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 570/1148] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:33:51 2022] POST /compute/v2.1/servers => generated 403 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:33:52.322451 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-18a12579-f176-4122-84df-ce3a6dda79bb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:52.323364 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-18a12579-f176-4122-84df-ce3a6dda79bb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:52.382150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-18a12579-f176-4122-84df-ce3a6dda79bb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:52.389685 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-18a12579-f176-4122-84df-ce3a6dda79bb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1241 microversion: 2.1 time: 0.072079 Aug 04 22:33:52.390267 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 579/1149] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:52 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:53.411360 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-290abcb6-0d83-40cb-aee7-ee02641b6693 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:53.411982 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-290abcb6-0d83-40cb-aee7-ee02641b6693 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:53.421972 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-290abcb6-0d83-40cb-aee7-ee02641b6693 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:53.422588 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-290abcb6-0d83-40cb-aee7-ee02641b6693 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:53.423098 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-290abcb6-0d83-40cb-aee7-ee02641b6693 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:53.423881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-290abcb6-0d83-40cb-aee7-ee02641b6693 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:53.424581 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-290abcb6-0d83-40cb-aee7-ee02641b6693 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:53.425085 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-290abcb6-0d83-40cb-aee7-ee02641b6693 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:53.498461 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-290abcb6-0d83-40cb-aee7-ee02641b6693 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:53.508733 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-290abcb6-0d83-40cb-aee7-ee02641b6693 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1301 microversion: 2.1 time: 0.099110 Aug 04 22:33:53.509695 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 571/1150] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:53 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1301 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:54.530969 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-510a4425-aaf1-4645-a438-6ffd0d2a7ad9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:54.531608 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-510a4425-aaf1-4645-a438-6ffd0d2a7ad9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:54.538924 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-510a4425-aaf1-4645-a438-6ffd0d2a7ad9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:54.539412 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-510a4425-aaf1-4645-a438-6ffd0d2a7ad9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:54.539839 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-510a4425-aaf1-4645-a438-6ffd0d2a7ad9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:54.541204 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-510a4425-aaf1-4645-a438-6ffd0d2a7ad9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:54.541867 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-510a4425-aaf1-4645-a438-6ffd0d2a7ad9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:54.542299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-510a4425-aaf1-4645-a438-6ffd0d2a7ad9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:54.781267 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-510a4425-aaf1-4645-a438-6ffd0d2a7ad9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:54.789100 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-510a4425-aaf1-4645-a438-6ffd0d2a7ad9 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1366 microversion: 2.1 time: 0.261857 Aug 04 22:33:54.789818 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 580/1151] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:54 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:55.359980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-d98f6118-882d-4393-a145-03f5212f2c68 req-c9b10dfd-7506-45c8-a0ab-4d75105fcf8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49dbb368-7761-47bf-a21e-5c9f299b3be6", "tag": "d51d028c-fcad-4808-80d6-b467621d351b"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:33:55.372385 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-d98f6118-882d-4393-a145-03f5212f2c68 req-c9b10dfd-7506-45c8-a0ab-4d75105fcf8a service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:55.372868 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-d98f6118-882d-4393-a145-03f5212f2c68 req-c9b10dfd-7506-45c8-a0ab-4d75105fcf8a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:55.373304 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-d98f6118-882d-4393-a145-03f5212f2c68 req-c9b10dfd-7506-45c8-a0ab-4d75105fcf8a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:55.391700 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-d98f6118-882d-4393-a145-03f5212f2c68 req-c9b10dfd-7506-45c8-a0ab-4d75105fcf8a service nova] Creating event network-changed:d51d028c-fcad-4808-80d6-b467621d351b for instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 on hv-cinder-85221 Aug 04 22:33:55.397708 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-d98f6118-882d-4393-a145-03f5212f2c68 req-c9b10dfd-7506-45c8-a0ab-4d75105fcf8a service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042307 Aug 04 22:33:55.398440 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 572/1152] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:33:55.812222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ac97146f-157f-4e96-9701-708d75162b81 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:55.812751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ac97146f-157f-4e96-9701-708d75162b81 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:55.819235 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ac97146f-157f-4e96-9701-708d75162b81 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:55.819873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ac97146f-157f-4e96-9701-708d75162b81 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:55.820317 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ac97146f-157f-4e96-9701-708d75162b81 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:55.821027 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ac97146f-157f-4e96-9701-708d75162b81 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:55.821546 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ac97146f-157f-4e96-9701-708d75162b81 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:55.821987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ac97146f-157f-4e96-9701-708d75162b81 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:55.954242 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-ac97146f-157f-4e96-9701-708d75162b81 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:55.962356 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ac97146f-157f-4e96-9701-708d75162b81 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1366 microversion: 2.1 time: 0.154525 Aug 04 22:33:55.963238 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 581/1153] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:55 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:56.985788 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-19abea2a-5e87-4b74-bbb8-4a27c4ab9209 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:56.986407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-19abea2a-5e87-4b74-bbb8-4a27c4ab9209 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:56.992521 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-19abea2a-5e87-4b74-bbb8-4a27c4ab9209 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:56.993001 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-19abea2a-5e87-4b74-bbb8-4a27c4ab9209 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:56.994028 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-19abea2a-5e87-4b74-bbb8-4a27c4ab9209 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:56.994708 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-19abea2a-5e87-4b74-bbb8-4a27c4ab9209 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:56.995161 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-19abea2a-5e87-4b74-bbb8-4a27c4ab9209 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:56.995584 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-19abea2a-5e87-4b74-bbb8-4a27c4ab9209 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:57.128409 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-19abea2a-5e87-4b74-bbb8-4a27c4ab9209 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:57.136546 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-19abea2a-5e87-4b74-bbb8-4a27c4ab9209 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1366 microversion: 2.1 time: 0.155430 Aug 04 22:33:57.137196 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 573/1154] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:56 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:58.222018 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-4be1a5f7-8676-4f6f-8888-1219b5c7c0d4 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:58.222890 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-4be1a5f7-8676-4f6f-8888-1219b5c7c0d4 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:58.230667 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4be1a5f7-8676-4f6f-8888-1219b5c7c0d4 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:58.231320 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4be1a5f7-8676-4f6f-8888-1219b5c7c0d4 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:58.231769 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4be1a5f7-8676-4f6f-8888-1219b5c7c0d4 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:58.232472 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4be1a5f7-8676-4f6f-8888-1219b5c7c0d4 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:58.232960 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4be1a5f7-8676-4f6f-8888-1219b5c7c0d4 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:58.233386 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-4be1a5f7-8676-4f6f-8888-1219b5c7c0d4 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:58.445482 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-4be1a5f7-8676-4f6f-8888-1219b5c7c0d4 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:58.453543 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-4be1a5f7-8676-4f6f-8888-1219b5c7c0d4 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1366 microversion: 2.1 time: 0.299576 Aug 04 22:33:58.454121 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 582/1155] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:58 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:33:59.475081 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-cbf2f08e-64e5-4355-8ad7-088c7c29c074 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:33:59.475619 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-cbf2f08e-64e5-4355-8ad7-088c7c29c074 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:33:59.481798 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbf2f08e-64e5-4355-8ad7-088c7c29c074 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:59.482275 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbf2f08e-64e5-4355-8ad7-088c7c29c074 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:59.482714 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbf2f08e-64e5-4355-8ad7-088c7c29c074 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:59.483402 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbf2f08e-64e5-4355-8ad7-088c7c29c074 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:33:59.483849 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbf2f08e-64e5-4355-8ad7-088c7c29c074 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:33:59.484267 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cbf2f08e-64e5-4355-8ad7-088c7c29c074 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:33:59.612814 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-cbf2f08e-64e5-4355-8ad7-088c7c29c074 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:33:59.620294 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-cbf2f08e-64e5-4355-8ad7-088c7c29c074 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1366 microversion: 2.1 time: 0.149973 Aug 04 22:33:59.620860 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 574/1156] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:33:59 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:00.640313 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8f2d3b7e-8986-47d4-a0ab-6db777f70675 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:00.640912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8f2d3b7e-8986-47d4-a0ab-6db777f70675 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:00.647220 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f2d3b7e-8986-47d4-a0ab-6db777f70675 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:00.647699 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f2d3b7e-8986-47d4-a0ab-6db777f70675 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:00.648132 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f2d3b7e-8986-47d4-a0ab-6db777f70675 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:00.648822 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f2d3b7e-8986-47d4-a0ab-6db777f70675 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:00.649924 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f2d3b7e-8986-47d4-a0ab-6db777f70675 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:00.650353 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f2d3b7e-8986-47d4-a0ab-6db777f70675 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:00.678917 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-f17592f1-fba6-485e-83e6-8fa3e3c88d6d req-a08ab099-a60a-4baa-b2f5-1dc686c021b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49dbb368-7761-47bf-a21e-5c9f299b3be6", "name": "network-vif-plugged", "status": "completed", "tag": "d51d028c-fcad-4808-80d6-b467621d351b"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:34:00.692834 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-f17592f1-fba6-485e-83e6-8fa3e3c88d6d req-a08ab099-a60a-4baa-b2f5-1dc686c021b5 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:00.693680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-f17592f1-fba6-485e-83e6-8fa3e3c88d6d req-a08ab099-a60a-4baa-b2f5-1dc686c021b5 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:00.694210 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-f17592f1-fba6-485e-83e6-8fa3e3c88d6d req-a08ab099-a60a-4baa-b2f5-1dc686c021b5 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:00.708770 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-f17592f1-fba6-485e-83e6-8fa3e3c88d6d req-a08ab099-a60a-4baa-b2f5-1dc686c021b5 service nova] Creating event network-vif-plugged:d51d028c-fcad-4808-80d6-b467621d351b for instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 on hv-cinder-85221 Aug 04 22:34:00.714734 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-f17592f1-fba6-485e-83e6-8fa3e3c88d6d req-a08ab099-a60a-4baa-b2f5-1dc686c021b5 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039492 Aug 04 22:34:00.715753 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 575/1157] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:34:00.791032 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8f2d3b7e-8986-47d4-a0ab-6db777f70675 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:00.798658 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8f2d3b7e-8986-47d4-a0ab-6db777f70675 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1366 microversion: 2.1 time: 0.162184 Aug 04 22:34:00.799233 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 583/1158] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:00 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:01.819824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c5d1eba7-67f1-4169-93ce-d80db3f4ec02 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:01.820439 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c5d1eba7-67f1-4169-93ce-d80db3f4ec02 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:01.827086 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c5d1eba7-67f1-4169-93ce-d80db3f4ec02 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:01.827564 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c5d1eba7-67f1-4169-93ce-d80db3f4ec02 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:01.827995 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c5d1eba7-67f1-4169-93ce-d80db3f4ec02 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:01.828678 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c5d1eba7-67f1-4169-93ce-d80db3f4ec02 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:01.829153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c5d1eba7-67f1-4169-93ce-d80db3f4ec02 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:01.829603 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c5d1eba7-67f1-4169-93ce-d80db3f4ec02 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:02.109747 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c5d1eba7-67f1-4169-93ce-d80db3f4ec02 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:02.117082 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c5d1eba7-67f1-4169-93ce-d80db3f4ec02 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1366 microversion: 2.1 time: 0.301560 Aug 04 22:34:02.117661 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 576/1159] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:01 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:03.139772 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e39a5aee-f192-4545-b62a-85bc9d146ee5 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:03.140404 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e39a5aee-f192-4545-b62a-85bc9d146ee5 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:03.143057 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=6 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:03.148388 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e39a5aee-f192-4545-b62a-85bc9d146ee5 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:03.148977 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e39a5aee-f192-4545-b62a-85bc9d146ee5 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:03.149432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e39a5aee-f192-4545-b62a-85bc9d146ee5 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:03.150224 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e39a5aee-f192-4545-b62a-85bc9d146ee5 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:03.150708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e39a5aee-f192-4545-b62a-85bc9d146ee5 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:03.151138 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e39a5aee-f192-4545-b62a-85bc9d146ee5 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:03.293771 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e39a5aee-f192-4545-b62a-85bc9d146ee5 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:03.301249 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e39a5aee-f192-4545-b62a-85bc9d146ee5 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1552 microversion: 2.1 time: 0.165610 Aug 04 22:34:03.301872 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 584/1160] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:03 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:34:03.322466 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7b4edccf-338a-4db8-b10a-8e71ec688dcf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:03.322994 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7b4edccf-338a-4db8-b10a-8e71ec688dcf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:03.324884 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:03.325687 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=10 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:03.331605 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b4edccf-338a-4db8-b10a-8e71ec688dcf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:03.332091 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b4edccf-338a-4db8-b10a-8e71ec688dcf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:03.332517 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b4edccf-338a-4db8-b10a-8e71ec688dcf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:03.333200 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b4edccf-338a-4db8-b10a-8e71ec688dcf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:03.333691 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b4edccf-338a-4db8-b10a-8e71ec688dcf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:03.334111 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7b4edccf-338a-4db8-b10a-8e71ec688dcf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:03.411356 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7b4edccf-338a-4db8-b10a-8e71ec688dcf tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093319 Aug 04 22:34:03.411938 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 577/1161] 10.222.0.109 () {58 vars in 1280 bytes} [Thu Aug 4 22:34:03 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:34:04.617625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-fdd5f61b-da0f-4b48-8538-d58a54d45df2 req-209f5b18-2d96-4d41-b417-15b1fc8472b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49dbb368-7761-47bf-a21e-5c9f299b3be6", "tag": "d51d028c-fcad-4808-80d6-b467621d351b"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:34:04.627541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-fdd5f61b-da0f-4b48-8538-d58a54d45df2 req-209f5b18-2d96-4d41-b417-15b1fc8472b5 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:04.628019 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-fdd5f61b-da0f-4b48-8538-d58a54d45df2 req-209f5b18-2d96-4d41-b417-15b1fc8472b5 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:04.628454 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-fdd5f61b-da0f-4b48-8538-d58a54d45df2 req-209f5b18-2d96-4d41-b417-15b1fc8472b5 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:04.639419 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-fdd5f61b-da0f-4b48-8538-d58a54d45df2 req-209f5b18-2d96-4d41-b417-15b1fc8472b5 service nova] Creating event network-changed:d51d028c-fcad-4808-80d6-b467621d351b for instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 on hv-cinder-85221 Aug 04 22:34:04.644701 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-fdd5f61b-da0f-4b48-8538-d58a54d45df2 req-209f5b18-2d96-4d41-b417-15b1fc8472b5 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030699 Aug 04 22:34:04.645318 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 585/1162] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:34:06.749558 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1165016817", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1818150918", "security_groups": [{"name": "tempest-secgroup-smoke-1118840594"}], "block_device_mapping_v2": [{"uuid": "4027ba0a-416f-42b3-ab63-4796033fbf28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94e914cb-0766-4758-bbaa-283c7e48c0dc"}]}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:34:06.859720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.network.neutron [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] validate_networks() for [('94e914cb-0766-4758-bbaa-283c7e48c0dc', None, None, None, None, None)] {{(pid=129197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:34:07.219519 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Flavor limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:34:07.219950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Image limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:34:07.220426 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Flavor pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:34:07.220836 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Image pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:34:07.221248 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:34:07.230838 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:07.231321 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:07.231755 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:07.232514 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:07.232975 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:07.233400 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:07.249908 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Getting quotas for project 49576f2166cc4b7f9261bd7cbc8384f4. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:34:07.253844 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Getting quotas for user 43e543cfa3e1402e9694dcb095a26c00 and project 49576f2166cc4b7f9261bd7cbc8384f4. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:34:07.310614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Going to run 1 instances... {{(pid=129197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:34:07.312708 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4027ba0a-416f-42b3-ab63-4796033fbf28',volume_size=None,volume_type=None)] {{(pid=129197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:34:07.442972 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-502b5669-6fd4-47ed-87da-da9105d150cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.697931 Aug 04 22:34:07.443608 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 578/1163] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:34:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:34:07.455802 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-56ab8563-be78-4bfe-8650-7110b1e26f9a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:07.456500 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-56ab8563-be78-4bfe-8650-7110b1e26f9a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:07.514643 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-56ab8563-be78-4bfe-8650-7110b1e26f9a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:07.522953 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-56ab8563-be78-4bfe-8650-7110b1e26f9a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1098 microversion: 2.1 time: 0.071146 Aug 04 22:34:07.523414 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 586/1164] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:07 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1098 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:08.545853 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-248b7e77-0f7a-48e2-be3f-469f6139cde9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:08.546875 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-248b7e77-0f7a-48e2-be3f-469f6139cde9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:08.553679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-248b7e77-0f7a-48e2-be3f-469f6139cde9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:08.554167 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-248b7e77-0f7a-48e2-be3f-469f6139cde9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:08.554658 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-248b7e77-0f7a-48e2-be3f-469f6139cde9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:08.555715 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-248b7e77-0f7a-48e2-be3f-469f6139cde9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:08.556177 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-248b7e77-0f7a-48e2-be3f-469f6139cde9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:08.556608 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-248b7e77-0f7a-48e2-be3f-469f6139cde9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:08.620298 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-248b7e77-0f7a-48e2-be3f-469f6139cde9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:08.627710 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-248b7e77-0f7a-48e2-be3f-469f6139cde9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1214 microversion: 2.1 time: 0.087721 Aug 04 22:34:08.628297 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 579/1165] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:08 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:34:09.648235 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9dbda2a2-3cd0-40ba-850c-846d88b2db39 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:09.649499 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9dbda2a2-3cd0-40ba-850c-846d88b2db39 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:09.656667 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9dbda2a2-3cd0-40ba-850c-846d88b2db39 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:09.657161 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9dbda2a2-3cd0-40ba-850c-846d88b2db39 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:09.657632 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9dbda2a2-3cd0-40ba-850c-846d88b2db39 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:09.658332 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9dbda2a2-3cd0-40ba-850c-846d88b2db39 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:09.658787 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9dbda2a2-3cd0-40ba-850c-846d88b2db39 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:09.659220 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9dbda2a2-3cd0-40ba-850c-846d88b2db39 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:09.856469 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9dbda2a2-3cd0-40ba-850c-846d88b2db39 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:09.863975 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9dbda2a2-3cd0-40ba-850c-846d88b2db39 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1270 microversion: 2.1 time: 0.219674 Aug 04 22:34:09.864551 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 587/1166] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:09 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1270 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:09.925878 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-9990d27b-7548-4ec1-bcb9-b4efa70fc800 req-df13a072-ba92-4dc7-bc42-30730c1ec9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6", "tag": "b95d5420-6dc0-4b63-ac13-7bf8cba30d67"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:34:09.936006 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-9990d27b-7548-4ec1-bcb9-b4efa70fc800 req-df13a072-ba92-4dc7-bc42-30730c1ec9b2 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:09.936490 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-9990d27b-7548-4ec1-bcb9-b4efa70fc800 req-df13a072-ba92-4dc7-bc42-30730c1ec9b2 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:09.936932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-9990d27b-7548-4ec1-bcb9-b4efa70fc800 req-df13a072-ba92-4dc7-bc42-30730c1ec9b2 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:09.949619 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-9990d27b-7548-4ec1-bcb9-b4efa70fc800 req-df13a072-ba92-4dc7-bc42-30730c1ec9b2 service nova] Creating event network-changed:b95d5420-6dc0-4b63-ac13-7bf8cba30d67 for instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 on hv-cinder-85221 Aug 04 22:34:09.955160 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-9990d27b-7548-4ec1-bcb9-b4efa70fc800 req-df13a072-ba92-4dc7-bc42-30730c1ec9b2 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032602 Aug 04 22:34:09.956212 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 580/1167] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:34:10.885364 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6419606c-5de9-4375-85a2-4524bfe4ce65 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:10.886082 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6419606c-5de9-4375-85a2-4524bfe4ce65 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:10.894285 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6419606c-5de9-4375-85a2-4524bfe4ce65 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:10.895003 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6419606c-5de9-4375-85a2-4524bfe4ce65 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:10.895695 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6419606c-5de9-4375-85a2-4524bfe4ce65 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:10.896776 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6419606c-5de9-4375-85a2-4524bfe4ce65 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:10.897461 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6419606c-5de9-4375-85a2-4524bfe4ce65 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:10.898102 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6419606c-5de9-4375-85a2-4524bfe4ce65 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:11.034073 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6419606c-5de9-4375-85a2-4524bfe4ce65 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:11.041844 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6419606c-5de9-4375-85a2-4524bfe4ce65 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1270 microversion: 2.1 time: 0.160551 Aug 04 22:34:11.042403 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 588/1168] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:10 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:12.062983 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-93b00ca7-a26d-4e2f-851b-136e7c01e7b6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:12.063678 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-93b00ca7-a26d-4e2f-851b-136e7c01e7b6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:12.069725 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93b00ca7-a26d-4e2f-851b-136e7c01e7b6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:12.070322 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93b00ca7-a26d-4e2f-851b-136e7c01e7b6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:12.070752 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93b00ca7-a26d-4e2f-851b-136e7c01e7b6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:12.071434 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93b00ca7-a26d-4e2f-851b-136e7c01e7b6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:12.071884 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93b00ca7-a26d-4e2f-851b-136e7c01e7b6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:12.072303 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-93b00ca7-a26d-4e2f-851b-136e7c01e7b6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:12.206970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-93b00ca7-a26d-4e2f-851b-136e7c01e7b6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:12.215124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-93b00ca7-a26d-4e2f-851b-136e7c01e7b6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1270 microversion: 2.1 time: 0.156813 Aug 04 22:34:12.215679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 581/1169] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:12 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:13.236068 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-2036085e-a014-49c9-871a-22cc54913375 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:13.236686 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-2036085e-a014-49c9-871a-22cc54913375 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:13.244241 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2036085e-a014-49c9-871a-22cc54913375 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:13.244721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2036085e-a014-49c9-871a-22cc54913375 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:13.245159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2036085e-a014-49c9-871a-22cc54913375 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:13.245873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2036085e-a014-49c9-871a-22cc54913375 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:13.246330 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2036085e-a014-49c9-871a-22cc54913375 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:13.246754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2036085e-a014-49c9-871a-22cc54913375 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:13.381360 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2036085e-a014-49c9-871a-22cc54913375 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:13.388791 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-2036085e-a014-49c9-871a-22cc54913375 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1270 microversion: 2.1 time: 0.156639 Aug 04 22:34:13.389348 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 589/1170] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:13 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:14.409673 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-dc75e565-4310-4eeb-b030-8b79f156f525 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:14.410210 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-dc75e565-4310-4eeb-b030-8b79f156f525 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:14.418089 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dc75e565-4310-4eeb-b030-8b79f156f525 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:14.418571 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dc75e565-4310-4eeb-b030-8b79f156f525 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:14.419002 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dc75e565-4310-4eeb-b030-8b79f156f525 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:14.419693 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dc75e565-4310-4eeb-b030-8b79f156f525 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:14.420142 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dc75e565-4310-4eeb-b030-8b79f156f525 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:14.420561 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dc75e565-4310-4eeb-b030-8b79f156f525 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:14.555879 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-dc75e565-4310-4eeb-b030-8b79f156f525 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:14.558174 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:14.564897 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-dc75e565-4310-4eeb-b030-8b79f156f525 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1270 microversion: 2.1 time: 0.159292 Aug 04 22:34:14.565476 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 582/1171] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:14 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:15.588962 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-fd8a439a-dc85-4397-ba8c-e31a39360a7e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:15.589604 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-fd8a439a-dc85-4397-ba8c-e31a39360a7e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:15.592035 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:15.597649 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd8a439a-dc85-4397-ba8c-e31a39360a7e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:15.598124 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd8a439a-dc85-4397-ba8c-e31a39360a7e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:15.598553 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd8a439a-dc85-4397-ba8c-e31a39360a7e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:15.599238 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd8a439a-dc85-4397-ba8c-e31a39360a7e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:15.599685 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd8a439a-dc85-4397-ba8c-e31a39360a7e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:15.600103 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-fd8a439a-dc85-4397-ba8c-e31a39360a7e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:15.604667 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=73 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:15.730832 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-fd8a439a-dc85-4397-ba8c-e31a39360a7e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:15.738132 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-fd8a439a-dc85-4397-ba8c-e31a39360a7e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1270 microversion: 2.1 time: 0.153907 Aug 04 22:34:15.738693 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 590/1172] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:15 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:16.759253 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-83c4e13d-d532-45b9-990b-f8affed37e70 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:16.759871 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-83c4e13d-d532-45b9-990b-f8affed37e70 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:16.762494 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:16.769097 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-83c4e13d-d532-45b9-990b-f8affed37e70 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:16.769625 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-83c4e13d-d532-45b9-990b-f8affed37e70 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:16.770069 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-83c4e13d-d532-45b9-990b-f8affed37e70 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:16.770771 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-83c4e13d-d532-45b9-990b-f8affed37e70 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:16.771228 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-83c4e13d-d532-45b9-990b-f8affed37e70 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:16.771688 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-83c4e13d-d532-45b9-990b-f8affed37e70 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:16.901832 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-83c4e13d-d532-45b9-990b-f8affed37e70 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:16.909093 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-83c4e13d-d532-45b9-990b-f8affed37e70 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1270 microversion: 2.1 time: 0.154400 Aug 04 22:34:16.909678 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 583/1173] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:16 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:17.929304 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-24d2a07b-81ff-48b9-9297-1e46d183d7f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:17.929942 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-24d2a07b-81ff-48b9-9297-1e46d183d7f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:17.932191 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:17.937501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-24d2a07b-81ff-48b9-9297-1e46d183d7f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:17.937976 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-24d2a07b-81ff-48b9-9297-1e46d183d7f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:17.938405 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-24d2a07b-81ff-48b9-9297-1e46d183d7f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:17.939085 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-24d2a07b-81ff-48b9-9297-1e46d183d7f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:17.939527 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-24d2a07b-81ff-48b9-9297-1e46d183d7f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:17.939942 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-24d2a07b-81ff-48b9-9297-1e46d183d7f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:18.068357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-24d2a07b-81ff-48b9-9297-1e46d183d7f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:18.076329 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-24d2a07b-81ff-48b9-9297-1e46d183d7f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1270 microversion: 2.1 time: 0.150836 Aug 04 22:34:18.076894 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 591/1174] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:17 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:19.098151 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d8b0bc81-a1c4-48f9-bf6e-e4534b8dd02e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:19.098793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d8b0bc81-a1c4-48f9-bf6e-e4534b8dd02e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:19.100619 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:19.101849 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=6 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:19.108440 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8b0bc81-a1c4-48f9-bf6e-e4534b8dd02e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:19.108929 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8b0bc81-a1c4-48f9-bf6e-e4534b8dd02e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:19.109364 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8b0bc81-a1c4-48f9-bf6e-e4534b8dd02e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:19.110094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8b0bc81-a1c4-48f9-bf6e-e4534b8dd02e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:19.110553 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8b0bc81-a1c4-48f9-bf6e-e4534b8dd02e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:19.110982 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d8b0bc81-a1c4-48f9-bf6e-e4534b8dd02e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:19.248839 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d8b0bc81-a1c4-48f9-bf6e-e4534b8dd02e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:19.256319 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d8b0bc81-a1c4-48f9-bf6e-e4534b8dd02e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1270 microversion: 2.1 time: 0.162138 Aug 04 22:34:19.257435 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 584/1175] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:19 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:20.282621 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3a2dd3fe-9cef-4c6b-a14e-845830be6dc9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:20.283242 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3a2dd3fe-9cef-4c6b-a14e-845830be6dc9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:20.290201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3a2dd3fe-9cef-4c6b-a14e-845830be6dc9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:20.290684 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3a2dd3fe-9cef-4c6b-a14e-845830be6dc9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:20.291123 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3a2dd3fe-9cef-4c6b-a14e-845830be6dc9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:20.291820 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3a2dd3fe-9cef-4c6b-a14e-845830be6dc9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:20.292275 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3a2dd3fe-9cef-4c6b-a14e-845830be6dc9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:20.292708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3a2dd3fe-9cef-4c6b-a14e-845830be6dc9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:20.428601 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-3a2dd3fe-9cef-4c6b-a14e-845830be6dc9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:20.436137 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3a2dd3fe-9cef-4c6b-a14e-845830be6dc9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1270 microversion: 2.1 time: 0.157369 Aug 04 22:34:20.436702 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 592/1176] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:20 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:34:20.818729 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-07cf202c-f873-421d-bb77-68261597fbbc req-6f5b5c3f-57f1-461b-aa9d-e8e17bc557d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6", "name": "network-vif-plugged", "status": "completed", "tag": "b95d5420-6dc0-4b63-ac13-7bf8cba30d67"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:34:20.829441 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-07cf202c-f873-421d-bb77-68261597fbbc req-6f5b5c3f-57f1-461b-aa9d-e8e17bc557d7 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:20.829920 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-07cf202c-f873-421d-bb77-68261597fbbc req-6f5b5c3f-57f1-461b-aa9d-e8e17bc557d7 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:20.830534 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-07cf202c-f873-421d-bb77-68261597fbbc req-6f5b5c3f-57f1-461b-aa9d-e8e17bc557d7 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:20.843342 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-07cf202c-f873-421d-bb77-68261597fbbc req-6f5b5c3f-57f1-461b-aa9d-e8e17bc557d7 service nova] Creating event network-vif-plugged:b95d5420-6dc0-4b63-ac13-7bf8cba30d67 for instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 on hv-cinder-85221 Aug 04 22:34:20.848319 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-07cf202c-f873-421d-bb77-68261597fbbc req-6f5b5c3f-57f1-461b-aa9d-e8e17bc557d7 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033284 Aug 04 22:34:20.848978 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 585/1177] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:34:21.456136 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c2087cf3-a718-4154-a11d-a6755d4f6d18 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:21.456667 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c2087cf3-a718-4154-a11d-a6755d4f6d18 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:21.464331 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c2087cf3-a718-4154-a11d-a6755d4f6d18 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:21.464819 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c2087cf3-a718-4154-a11d-a6755d4f6d18 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:21.465257 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c2087cf3-a718-4154-a11d-a6755d4f6d18 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:21.465988 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c2087cf3-a718-4154-a11d-a6755d4f6d18 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:21.466447 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c2087cf3-a718-4154-a11d-a6755d4f6d18 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:21.466877 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c2087cf3-a718-4154-a11d-a6755d4f6d18 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:21.603002 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c2087cf3-a718-4154-a11d-a6755d4f6d18 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:21.610462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c2087cf3-a718-4154-a11d-a6755d4f6d18 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1270 microversion: 2.1 time: 0.158257 Aug 04 22:34:21.611021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 593/1178] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:21 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:22.633098 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ddc6e08f-4943-4ddc-bf96-76c333cf02e2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:22.633831 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ddc6e08f-4943-4ddc-bf96-76c333cf02e2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:22.640000 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ddc6e08f-4943-4ddc-bf96-76c333cf02e2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:22.640492 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ddc6e08f-4943-4ddc-bf96-76c333cf02e2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:22.640932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ddc6e08f-4943-4ddc-bf96-76c333cf02e2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:22.641662 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ddc6e08f-4943-4ddc-bf96-76c333cf02e2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:22.642119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ddc6e08f-4943-4ddc-bf96-76c333cf02e2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:22.642548 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ddc6e08f-4943-4ddc-bf96-76c333cf02e2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:22.774258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ddc6e08f-4943-4ddc-bf96-76c333cf02e2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:22.781722 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ddc6e08f-4943-4ddc-bf96-76c333cf02e2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1270 microversion: 2.1 time: 0.153303 Aug 04 22:34:22.782285 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 586/1179] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:22 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:23.802578 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-00bdc7a3-9583-43d6-9b6a-e02e59952793 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:23.803201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-00bdc7a3-9583-43d6-9b6a-e02e59952793 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:23.810335 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-00bdc7a3-9583-43d6-9b6a-e02e59952793 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:23.810810 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-00bdc7a3-9583-43d6-9b6a-e02e59952793 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:23.811238 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-00bdc7a3-9583-43d6-9b6a-e02e59952793 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:23.811919 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-00bdc7a3-9583-43d6-9b6a-e02e59952793 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:23.812366 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-00bdc7a3-9583-43d6-9b6a-e02e59952793 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:23.812785 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-00bdc7a3-9583-43d6-9b6a-e02e59952793 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:23.942120 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-00bdc7a3-9583-43d6-9b6a-e02e59952793 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:23.949614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-00bdc7a3-9583-43d6-9b6a-e02e59952793 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1456 microversion: 2.1 time: 0.150810 Aug 04 22:34:23.950175 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 594/1180] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:23 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1456 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:34:23.969837 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d32006c3-7dd3-47f4-a2ad-513169661e86 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:34:23.970443 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d32006c3-7dd3-47f4-a2ad-513169661e86 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:34:23.978238 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d32006c3-7dd3-47f4-a2ad-513169661e86 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:23.978720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d32006c3-7dd3-47f4-a2ad-513169661e86 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:23.979153 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d32006c3-7dd3-47f4-a2ad-513169661e86 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:23.979872 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d32006c3-7dd3-47f4-a2ad-513169661e86 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:23.980329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d32006c3-7dd3-47f4-a2ad-513169661e86 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:23.980750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d32006c3-7dd3-47f4-a2ad-513169661e86 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:24.120456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d32006c3-7dd3-47f4-a2ad-513169661e86 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:34:24.128043 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d32006c3-7dd3-47f4-a2ad-513169661e86 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1456 microversion: 2.1 time: 0.161955 Aug 04 22:34:24.128635 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 587/1181] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:34:23 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1456 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:34:25.728857 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-603bec75-5939-40ba-8f0b-7658ec9970a2 req-b2e6e77d-7c29-41e1-b95b-88332df5d6ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6", "tag": "b95d5420-6dc0-4b63-ac13-7bf8cba30d67"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:34:25.739119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-603bec75-5939-40ba-8f0b-7658ec9970a2 req-b2e6e77d-7c29-41e1-b95b-88332df5d6ae service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:34:25.739695 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-603bec75-5939-40ba-8f0b-7658ec9970a2 req-b2e6e77d-7c29-41e1-b95b-88332df5d6ae service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:34:25.740191 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-603bec75-5939-40ba-8f0b-7658ec9970a2 req-b2e6e77d-7c29-41e1-b95b-88332df5d6ae service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:34:25.751719 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-603bec75-5939-40ba-8f0b-7658ec9970a2 req-b2e6e77d-7c29-41e1-b95b-88332df5d6ae service nova] Creating event network-changed:b95d5420-6dc0-4b63-ac13-7bf8cba30d67 for instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 on hv-cinder-85221 Aug 04 22:34:25.756905 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-603bec75-5939-40ba-8f0b-7658ec9970a2 req-b2e6e77d-7c29-41e1-b95b-88332df5d6ae service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032576 Aug 04 22:34:25.757841 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 595/1182] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:35:15.638759 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-899be9f1-c59f-46d6-975d-cb0b041dc238 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:15.639347 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-899be9f1-c59f-46d6-975d-cb0b041dc238 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:15.641587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=9 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:15.642395 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=27 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:15.648541 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-899be9f1-c59f-46d6-975d-cb0b041dc238 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:15.649034 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-899be9f1-c59f-46d6-975d-cb0b041dc238 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:15.649503 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-899be9f1-c59f-46d6-975d-cb0b041dc238 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:15.650208 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-899be9f1-c59f-46d6-975d-cb0b041dc238 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:15.650728 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-899be9f1-c59f-46d6-975d-cb0b041dc238 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:15.651172 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-899be9f1-c59f-46d6-975d-cb0b041dc238 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:15.674212 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-899be9f1-c59f-46d6-975d-cb0b041dc238 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/ips" status: 200 len: 146 microversion: 2.1 time: 0.039286 Aug 04 22:35:15.674945 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 588/1183] 10.222.0.109 () {58 vars in 1253 bytes} [Thu Aug 4 22:35:15 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:35:17.003968 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d037076b-624a-4d28-a29f-39bb324d6d00 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99df5927-2cf8-4e9f-a77a-08febb4c275e"}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:35:17.006414 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d037076b-624a-4d28-a29f-39bb324d6d00 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:17.008708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=11 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:17.009536 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=31 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:17.015538 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d037076b-624a-4d28-a29f-39bb324d6d00 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:17.016023 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d037076b-624a-4d28-a29f-39bb324d6d00 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:17.016462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d037076b-624a-4d28-a29f-39bb324d6d00 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:17.017153 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d037076b-624a-4d28-a29f-39bb324d6d00 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:17.017766 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d037076b-624a-4d28-a29f-39bb324d6d00 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:17.019224 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d037076b-624a-4d28-a29f-39bb324d6d00 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:17.377219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d037076b-624a-4d28-a29f-39bb324d6d00 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "POST /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377846 Aug 04 22:35:17.378846 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 596/1184] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:35:16 2022] POST /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:35:24.911334 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0511a578-9ac8-4895-89c9-05325a71bbc0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:24.913521 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0511a578-9ac8-4895-89c9-05325a71bbc0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:24.919933 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0511a578-9ac8-4895-89c9-05325a71bbc0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:24.920416 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0511a578-9ac8-4895-89c9-05325a71bbc0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:24.920852 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0511a578-9ac8-4895-89c9-05325a71bbc0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:24.921587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0511a578-9ac8-4895-89c9-05325a71bbc0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:24.922043 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0511a578-9ac8-4895-89c9-05325a71bbc0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:24.922466 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0511a578-9ac8-4895-89c9-05325a71bbc0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:24.954326 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0511a578-9ac8-4895-89c9-05325a71bbc0 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046952 Aug 04 22:35:24.955498 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 589/1185] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:35:24 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:35:24.967449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8fa88b67-6cde-44c2-9d59-d90b051ea82c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:24.968114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8fa88b67-6cde-44c2-9d59-d90b051ea82c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:24.975306 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fa88b67-6cde-44c2-9d59-d90b051ea82c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:24.975792 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fa88b67-6cde-44c2-9d59-d90b051ea82c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:24.976499 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fa88b67-6cde-44c2-9d59-d90b051ea82c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:24.977273 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fa88b67-6cde-44c2-9d59-d90b051ea82c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:24.977919 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fa88b67-6cde-44c2-9d59-d90b051ea82c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:24.978412 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8fa88b67-6cde-44c2-9d59-d90b051ea82c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:25.008525 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8fa88b67-6cde-44c2-9d59-d90b051ea82c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments/99df5927-2cf8-4e9f-a77a-08febb4c275e" status: 200 len: 194 microversion: 2.1 time: 0.046087 Aug 04 22:35:25.009121 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 597/1186] 10.222.0.109 () {58 vars in 1418 bytes} [Thu Aug 4 22:35:24 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments/99df5927-2cf8-4e9f-a77a-08febb4c275e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:35:26.344110 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6f36d570-4015-4228-b4cf-ad57b2c0b685 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3516521a-f83e-40ec-9f9b-e40bb3da1aef"}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:35:26.347679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6f36d570-4015-4228-b4cf-ad57b2c0b685 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:26.354119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f36d570-4015-4228-b4cf-ad57b2c0b685 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:26.354610 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f36d570-4015-4228-b4cf-ad57b2c0b685 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:26.355047 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f36d570-4015-4228-b4cf-ad57b2c0b685 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:26.355741 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f36d570-4015-4228-b4cf-ad57b2c0b685 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:26.356191 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f36d570-4015-4228-b4cf-ad57b2c0b685 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:26.356614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6f36d570-4015-4228-b4cf-ad57b2c0b685 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:26.674407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6f36d570-4015-4228-b4cf-ad57b2c0b685 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "POST /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334206 Aug 04 22:35:26.674996 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 590/1187] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:35:26 2022] POST /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:35:34.212344 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-d174add2-01c1-4e16-8d6d-49a12bf1cf21 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:34.214634 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-d174add2-01c1-4e16-8d6d-49a12bf1cf21 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:34.222251 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d174add2-01c1-4e16-8d6d-49a12bf1cf21 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:34.222813 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d174add2-01c1-4e16-8d6d-49a12bf1cf21 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:34.223256 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d174add2-01c1-4e16-8d6d-49a12bf1cf21 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:34.223949 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d174add2-01c1-4e16-8d6d-49a12bf1cf21 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:34.224407 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d174add2-01c1-4e16-8d6d-49a12bf1cf21 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:34.224836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-d174add2-01c1-4e16-8d6d-49a12bf1cf21 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:34.255414 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-d174add2-01c1-4e16-8d6d-49a12bf1cf21 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047418 Aug 04 22:35:34.255961 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 598/1188] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:35:34 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:35:34.392876 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-22c1c5d7-e42c-4f98-8a63-a2dff730040b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:34.393391 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-22c1c5d7-e42c-4f98-8a63-a2dff730040b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:34.399556 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-22c1c5d7-e42c-4f98-8a63-a2dff730040b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:34.400046 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-22c1c5d7-e42c-4f98-8a63-a2dff730040b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:34.400486 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-22c1c5d7-e42c-4f98-8a63-a2dff730040b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:34.401178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-22c1c5d7-e42c-4f98-8a63-a2dff730040b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:34.401667 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-22c1c5d7-e42c-4f98-8a63-a2dff730040b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:34.402108 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-22c1c5d7-e42c-4f98-8a63-a2dff730040b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:34.430705 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-22c1c5d7-e42c-4f98-8a63-a2dff730040b tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments/99df5927-2cf8-4e9f-a77a-08febb4c275e" status: 200 len: 194 microversion: 2.1 time: 0.043295 Aug 04 22:35:34.431272 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 591/1189] 10.222.0.109 () {58 vars in 1418 bytes} [Thu Aug 4 22:35:34 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments/99df5927-2cf8-4e9f-a77a-08febb4c275e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:35:34.441273 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e01faa10-949b-4fd0-b04f-0cb8a634a381 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:34.441796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e01faa10-949b-4fd0-b04f-0cb8a634a381 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:34.447639 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e01faa10-949b-4fd0-b04f-0cb8a634a381 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:34.448119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e01faa10-949b-4fd0-b04f-0cb8a634a381 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:34.448564 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e01faa10-949b-4fd0-b04f-0cb8a634a381 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:34.449252 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e01faa10-949b-4fd0-b04f-0cb8a634a381 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:34.449730 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e01faa10-949b-4fd0-b04f-0cb8a634a381 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:34.450158 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e01faa10-949b-4fd0-b04f-0cb8a634a381 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:34.531235 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-e01faa10-949b-4fd0-b04f-0cb8a634a381 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lazy-loading 'services' on Instance uuid 49dbb368-7761-47bf-a21e-5c9f299b3be6 {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:35:34.602485 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e01faa10-949b-4fd0-b04f-0cb8a634a381 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "DELETE /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments/99df5927-2cf8-4e9f-a77a-08febb4c275e" status: 202 len: 0 microversion: 2.1 time: 0.164910 Aug 04 22:35:34.603075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 599/1190] 10.222.0.109 () {58 vars in 1421 bytes} [Thu Aug 4 22:35:34 2022] DELETE /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments/99df5927-2cf8-4e9f-a77a-08febb4c275e => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:35:36.783051 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-16010c3a-c2ff-410f-a3ad-4a6cd8325bf3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:36.783713 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-16010c3a-c2ff-410f-a3ad-4a6cd8325bf3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:36.789956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-16010c3a-c2ff-410f-a3ad-4a6cd8325bf3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:36.790450 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-16010c3a-c2ff-410f-a3ad-4a6cd8325bf3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:36.790893 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-16010c3a-c2ff-410f-a3ad-4a6cd8325bf3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:36.791631 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-16010c3a-c2ff-410f-a3ad-4a6cd8325bf3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:36.792091 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-16010c3a-c2ff-410f-a3ad-4a6cd8325bf3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:36.792524 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-16010c3a-c2ff-410f-a3ad-4a6cd8325bf3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:36.820995 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-16010c3a-c2ff-410f-a3ad-4a6cd8325bf3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments/3516521a-f83e-40ec-9f9b-e40bb3da1aef" status: 200 len: 194 microversion: 2.1 time: 0.042453 Aug 04 22:35:36.821589 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 592/1191] 10.222.0.109 () {58 vars in 1418 bytes} [Thu Aug 4 22:35:36 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments/3516521a-f83e-40ec-9f9b-e40bb3da1aef => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:35:36.833856 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f433e9c9-d336-423a-8c37-aef1a49e3efb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:36.834421 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f433e9c9-d336-423a-8c37-aef1a49e3efb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:36.840455 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f433e9c9-d336-423a-8c37-aef1a49e3efb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:36.840930 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f433e9c9-d336-423a-8c37-aef1a49e3efb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:36.841364 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f433e9c9-d336-423a-8c37-aef1a49e3efb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:36.842075 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f433e9c9-d336-423a-8c37-aef1a49e3efb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:36.842517 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f433e9c9-d336-423a-8c37-aef1a49e3efb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:36.842935 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f433e9c9-d336-423a-8c37-aef1a49e3efb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:36.922260 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-f433e9c9-d336-423a-8c37-aef1a49e3efb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lazy-loading 'services' on Instance uuid 49dbb368-7761-47bf-a21e-5c9f299b3be6 {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:35:36.994510 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f433e9c9-d336-423a-8c37-aef1a49e3efb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "DELETE /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments/3516521a-f83e-40ec-9f9b-e40bb3da1aef" status: 202 len: 0 microversion: 2.1 time: 0.166181 Aug 04 22:35:36.995096 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 600/1192] 10.222.0.109 () {58 vars in 1421 bytes} [Thu Aug 4 22:35:36 2022] DELETE /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments/3516521a-f83e-40ec-9f9b-e40bb3da1aef => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:35:38.168029 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-dae29975-54e3-47f7-ac65-07fa2b620492 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:38.170467 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-dae29975-54e3-47f7-ac65-07fa2b620492 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:38.176874 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dae29975-54e3-47f7-ac65-07fa2b620492 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:38.177436 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dae29975-54e3-47f7-ac65-07fa2b620492 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:38.177948 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dae29975-54e3-47f7-ac65-07fa2b620492 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:38.178750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dae29975-54e3-47f7-ac65-07fa2b620492 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:38.179393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dae29975-54e3-47f7-ac65-07fa2b620492 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:38.179847 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-dae29975-54e3-47f7-ac65-07fa2b620492 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:38.209126 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-dae29975-54e3-47f7-ac65-07fa2b620492 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045616 Aug 04 22:35:38.209725 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 593/1193] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:35:38 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 22:35:38.323684 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-3689a559-621f-4477-b2d6-241b97a0e0d8 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:38.325975 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-3689a559-621f-4477-b2d6-241b97a0e0d8 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:38.332875 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3689a559-621f-4477-b2d6-241b97a0e0d8 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:38.333362 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3689a559-621f-4477-b2d6-241b97a0e0d8 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:38.333827 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3689a559-621f-4477-b2d6-241b97a0e0d8 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:38.334520 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3689a559-621f-4477-b2d6-241b97a0e0d8 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:38.334974 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3689a559-621f-4477-b2d6-241b97a0e0d8 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:38.335401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-3689a559-621f-4477-b2d6-241b97a0e0d8 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:38.363183 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-3689a559-621f-4477-b2d6-241b97a0e0d8 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044206 Aug 04 22:35:38.363731 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 601/1194] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:35:38 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 22:35:38.424540 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a4635f26-5c5c-4eff-a27e-ec8927eaa8f6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:38.425047 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a4635f26-5c5c-4eff-a27e-ec8927eaa8f6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:38.430901 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a4635f26-5c5c-4eff-a27e-ec8927eaa8f6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:38.431429 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a4635f26-5c5c-4eff-a27e-ec8927eaa8f6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:38.431873 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a4635f26-5c5c-4eff-a27e-ec8927eaa8f6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:38.432573 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a4635f26-5c5c-4eff-a27e-ec8927eaa8f6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:38.433030 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a4635f26-5c5c-4eff-a27e-ec8927eaa8f6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:38.433486 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-a4635f26-5c5c-4eff-a27e-ec8927eaa8f6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:38.458740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a4635f26-5c5c-4eff-a27e-ec8927eaa8f6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Going to try to terminate instance {{(pid=129197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:35:38.534216 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a4635f26-5c5c-4eff-a27e-ec8927eaa8f6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "DELETE /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 204 len: 0 microversion: 2.1 time: 0.113083 Aug 04 22:35:38.534865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 594/1195] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:35:38 2022] DELETE /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:35:38.543067 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f085f7ba-38b3-4c17-8309-fe795a82f9ca tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:38.543712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f085f7ba-38b3-4c17-8309-fe795a82f9ca tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:38.550366 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f085f7ba-38b3-4c17-8309-fe795a82f9ca tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:38.550846 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f085f7ba-38b3-4c17-8309-fe795a82f9ca tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:38.551283 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f085f7ba-38b3-4c17-8309-fe795a82f9ca tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:38.551975 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f085f7ba-38b3-4c17-8309-fe795a82f9ca tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:38.552430 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f085f7ba-38b3-4c17-8309-fe795a82f9ca tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:38.552854 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f085f7ba-38b3-4c17-8309-fe795a82f9ca tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:38.685016 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-f085f7ba-38b3-4c17-8309-fe795a82f9ca tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:35:38.692809 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f085f7ba-38b3-4c17-8309-fe795a82f9ca tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1677 microversion: 2.1 time: 0.153533 Aug 04 22:35:38.693382 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 602/1196] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:35:38 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:35:39.715064 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6b740def-397a-4cf6-b2c2-145287e2cc7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:39.715765 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6b740def-397a-4cf6-b2c2-145287e2cc7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:39.722244 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6b740def-397a-4cf6-b2c2-145287e2cc7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:39.722732 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6b740def-397a-4cf6-b2c2-145287e2cc7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:39.723175 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6b740def-397a-4cf6-b2c2-145287e2cc7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:39.723871 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6b740def-397a-4cf6-b2c2-145287e2cc7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:39.724329 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6b740def-397a-4cf6-b2c2-145287e2cc7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:39.724756 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6b740def-397a-4cf6-b2c2-145287e2cc7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:39.855956 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-6b740def-397a-4cf6-b2c2-145287e2cc7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:35:39.864100 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6b740def-397a-4cf6-b2c2-145287e2cc7c tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1677 microversion: 2.1 time: 0.153280 Aug 04 22:35:39.864663 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 595/1197] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:35:39 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:35:40.885658 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-475f7a8d-e35f-46ae-b469-b16317eca653 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:40.886270 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-475f7a8d-e35f-46ae-b469-b16317eca653 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:40.893240 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-475f7a8d-e35f-46ae-b469-b16317eca653 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:40.893771 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-475f7a8d-e35f-46ae-b469-b16317eca653 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:40.894207 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-475f7a8d-e35f-46ae-b469-b16317eca653 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:40.894904 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-475f7a8d-e35f-46ae-b469-b16317eca653 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:40.895357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-475f7a8d-e35f-46ae-b469-b16317eca653 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:40.895782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-475f7a8d-e35f-46ae-b469-b16317eca653 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:41.116305 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-475f7a8d-e35f-46ae-b469-b16317eca653 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:35:41.120310 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-475f7a8d-e35f-46ae-b469-b16317eca653 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1677 microversion: 2.1 time: 0.238470 Aug 04 22:35:41.121095 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 603/1198] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:35:40 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:35:41.687101 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-452b491d-0f37-4ba3-8abe-2864b1f60e88 req-7bce94b1-2f1e-49d6-bdc8-2448e39c3215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49dbb368-7761-47bf-a21e-5c9f299b3be6", "name": "network-vif-deleted", "tag": "d51d028c-fcad-4808-80d6-b467621d351b"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:35:41.697997 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-452b491d-0f37-4ba3-8abe-2864b1f60e88 req-7bce94b1-2f1e-49d6-bdc8-2448e39c3215 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:41.698486 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-452b491d-0f37-4ba3-8abe-2864b1f60e88 req-7bce94b1-2f1e-49d6-bdc8-2448e39c3215 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:41.699058 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-452b491d-0f37-4ba3-8abe-2864b1f60e88 req-7bce94b1-2f1e-49d6-bdc8-2448e39c3215 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:41.712078 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-452b491d-0f37-4ba3-8abe-2864b1f60e88 req-7bce94b1-2f1e-49d6-bdc8-2448e39c3215 service nova] Creating event network-vif-deleted:d51d028c-fcad-4808-80d6-b467621d351b for instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 on hv-cinder-85221 Aug 04 22:35:41.717080 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-452b491d-0f37-4ba3-8abe-2864b1f60e88 req-7bce94b1-2f1e-49d6-bdc8-2448e39c3215 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033637 Aug 04 22:35:41.718296 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 596/1199] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:35:42.144237 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:42.144956 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:42.151498 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:42.151998 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:42.152434 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:42.153136 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:42.153622 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:42.154279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:42.187219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:42.187704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:42.188934 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:42.190126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lazy-loading 'fault' on Instance uuid 49dbb368-7761-47bf-a21e-5c9f299b3be6 {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:35:42.239836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890f3e80ae37401f8dad15d3d084f091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477c661a08dd46b2a20f53a7944361ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:35:42.247170 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-46fcc508-bb68-44fc-b1d9-f33fd0d746eb tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 200 len: 1331 microversion: 2.1 time: 0.108125 Aug 04 22:35:42.247738 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 604/1200] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:35:42 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:35:43.271413 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0f9fc83f-1ebe-43ba-be64-204e3fc708df tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:43.272100 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0f9fc83f-1ebe-43ba-be64-204e3fc708df tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:43.278185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f9fc83f-1ebe-43ba-be64-204e3fc708df tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:43.278665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f9fc83f-1ebe-43ba-be64-204e3fc708df tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:43.279097 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f9fc83f-1ebe-43ba-be64-204e3fc708df tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:43.279791 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f9fc83f-1ebe-43ba-be64-204e3fc708df tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:43.280240 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f9fc83f-1ebe-43ba-be64-204e3fc708df tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:43.280660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f9fc83f-1ebe-43ba-be64-204e3fc708df tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:43.293995 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-0f9fc83f-1ebe-43ba-be64-204e3fc708df tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] HTTP exception thrown: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0f9fc83f-1ebe-43ba-be64-204e3fc708df tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Request method failure captured: Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 HTTP/1.1 Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EgqLFMVACCfMrY4J7ONHgYVvKlE4v1QQaBNNuJw33JDWgQa2db6oSCQWEEq_d_b3djeaziKxUdQ_9qQmAjT--Jhv1lA4NxTUfh9BHDtfniklooAXGTmTKdP-Y2X_3PJ23eoXVR642lr99fILTEz0z_dK9eEOKBdUHQzFw8agS4KWMI Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 477c661a08dd46b2a20f53a7944361ef Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:35:43.295671 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:35:43.298281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/477c661a08dd46b2a20f53a7944361ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_477c661a08dd46b2a20f53a7944361ef", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/477c661a08dd46b2a20f53a7944361ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/477c661a08dd46b2a20f53a7944361ef"}]}] Aug 04 22:35:43.298281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:43.298281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 477c661a08dd46b2a20f53a7944361ef Aug 04 22:35:43.298281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:43.298281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-AttachVolumeTestJSON-2021858786-project Aug 04 22:35:43.298281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:35:43.298281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:35:43.298281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 890f3e80ae37401f8dad15d3d084f091 Aug 04 22:35:43.298281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-AttachVolumeTestJSON-2021858786-project Aug 04 22:35:43.298281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:35:43.298281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:43.298281 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '49dbb368-7761-47bf-a21e-5c9f299b3be6'} Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:35:43.299311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:43.300905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:43.302358 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0f9fc83f-1ebe-43ba-be64-204e3fc708df tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Returning 404 to user: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:35:43.302358 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0f9fc83f-1ebe-43ba-be64-204e3fc708df tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 404 len: 111 microversion: 2.1 time: 0.030276 Aug 04 22:35:43.302358 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 597/1201] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:35:43 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:35:43.306469 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c7bdd2c0-5693-4778-8a7d-2ea4cfc14af7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '.version_select at 0x7fe7b2097670>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:43.325514 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c7bdd2c0-5693-4778-8a7d-2ea4cfc14af7 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571993974" status: 202 len: 0 microversion: 2.1 time: 0.022825 Aug 04 22:35:43.326060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 605/1202] 10.222.0.109 () {58 vars in 1226 bytes} [Thu Aug 4 22:35:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571993974 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:35:46.193269 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-caf64f5d-18c6-4516-9dd2-aa69016919a3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:46.193885 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-caf64f5d-18c6-4516-9dd2-aa69016919a3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:46.196279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:46.201507 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-caf64f5d-18c6-4516-9dd2-aa69016919a3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:46.202000 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-caf64f5d-18c6-4516-9dd2-aa69016919a3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:46.202448 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-caf64f5d-18c6-4516-9dd2-aa69016919a3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:46.203732 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-caf64f5d-18c6-4516-9dd2-aa69016919a3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:46.204193 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-caf64f5d-18c6-4516-9dd2-aa69016919a3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:46.204620 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-caf64f5d-18c6-4516-9dd2-aa69016919a3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:46.212022 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:46.222894 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-caf64f5d-18c6-4516-9dd2-aa69016919a3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] HTTP exception thrown: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-caf64f5d-18c6-4516-9dd2-aa69016919a3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Request method failure captured: Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: DELETE /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 HTTP/1.1 Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EgqLFMVACCfMrY4J7ONHgYVvKlE4v1QQaBNNuJw33JDWgQa2db6oSCQWEEq_d_b3djeaziKxUdQ_9qQmAjT--Jhv1lA4NxTUfh9BHDtfniklooAXGTmTKdP-Y2X_3PJ23eoXVR642lr99fILTEz0z_dK9eEOKBdUHQzFw8agS4KWMI Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 477c661a08dd46b2a20f53a7944361ef Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:35:46.224499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:35:46.226186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/477c661a08dd46b2a20f53a7944361ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_477c661a08dd46b2a20f53a7944361ef", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/477c661a08dd46b2a20f53a7944361ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/477c661a08dd46b2a20f53a7944361ef"}]}] Aug 04 22:35:46.226186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:46.226186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 477c661a08dd46b2a20f53a7944361ef Aug 04 22:35:46.226186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:46.226186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-AttachVolumeTestJSON-2021858786-project Aug 04 22:35:46.226186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:35:46.226186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:35:46.226186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 890f3e80ae37401f8dad15d3d084f091 Aug 04 22:35:46.226186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-AttachVolumeTestJSON-2021858786-project Aug 04 22:35:46.226186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:35:46.226186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:46.226186 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '49dbb368-7761-47bf-a21e-5c9f299b3be6'} Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:35:46.227130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:46.228647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:46.230138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-caf64f5d-18c6-4516-9dd2-aa69016919a3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Returning 404 to user: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:35:46.230138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-caf64f5d-18c6-4516-9dd2-aa69016919a3 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "DELETE /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 404 len: 111 microversion: 2.1 time: 0.036618 Aug 04 22:35:46.230138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 598/1203] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:35:46 2022] DELETE /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:35:46.235222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b567d759-2196-496b-bc90-1f8c0fcfdd40 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:46.235836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b567d759-2196-496b-bc90-1f8c0fcfdd40 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 49dbb368-7761-47bf-a21e-5c9f299b3be6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:46.244012 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b567d759-2196-496b-bc90-1f8c0fcfdd40 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:46.244486 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b567d759-2196-496b-bc90-1f8c0fcfdd40 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:46.244915 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b567d759-2196-496b-bc90-1f8c0fcfdd40 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:46.245633 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b567d759-2196-496b-bc90-1f8c0fcfdd40 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:46.246085 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b567d759-2196-496b-bc90-1f8c0fcfdd40 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:46.246510 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b567d759-2196-496b-bc90-1f8c0fcfdd40 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:46.259646 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-b567d759-2196-496b-bc90-1f8c0fcfdd40 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] HTTP exception thrown: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b567d759-2196-496b-bc90-1f8c0fcfdd40 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Request method failure captured: Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 HTTP/1.1 Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EgqLFMVACCfMrY4J7ONHgYVvKlE4v1QQaBNNuJw33JDWgQa2db6oSCQWEEq_d_b3djeaziKxUdQ_9qQmAjT--Jhv1lA4NxTUfh9BHDtfniklooAXGTmTKdP-Y2X_3PJ23eoXVR642lr99fILTEz0z_dK9eEOKBdUHQzFw8agS4KWMI Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 477c661a08dd46b2a20f53a7944361ef Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:35:46.261265 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:35:46.262926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/477c661a08dd46b2a20f53a7944361ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_477c661a08dd46b2a20f53a7944361ef", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/477c661a08dd46b2a20f53a7944361ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/477c661a08dd46b2a20f53a7944361ef"}]}] Aug 04 22:35:46.262926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:46.262926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 477c661a08dd46b2a20f53a7944361ef Aug 04 22:35:46.262926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:46.262926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeTestJSON-2021858786-project Aug 04 22:35:46.262926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:35:46.262926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:35:46.262926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 890f3e80ae37401f8dad15d3d084f091 Aug 04 22:35:46.262926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeTestJSON-2021858786-project Aug 04 22:35:46.262926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:35:46.262926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:46.262926 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': '49dbb368-7761-47bf-a21e-5c9f299b3be6'} Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:35:46.263793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. Aug 04 22:35:46.265296 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:46.267290 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b567d759-2196-496b-bc90-1f8c0fcfdd40 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Returning 404 to user: Instance 49dbb368-7761-47bf-a21e-5c9f299b3be6 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:35:46.267290 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b567d759-2196-496b-bc90-1f8c0fcfdd40 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6" status: 404 len: 111 microversion: 2.1 time: 0.031940 Aug 04 22:35:46.267290 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 606/1204] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:35:46 2022] GET /compute/v2.1/servers/49dbb368-7761-47bf-a21e-5c9f299b3be6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:35:47.405777 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d1f81c6c-16f8-49cc-b76d-4ea22dd1f5a6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:47.406325 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d1f81c6c-16f8-49cc-b76d-4ea22dd1f5a6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:47.414094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d1f81c6c-16f8-49cc-b76d-4ea22dd1f5a6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:47.414572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d1f81c6c-16f8-49cc-b76d-4ea22dd1f5a6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:47.415001 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d1f81c6c-16f8-49cc-b76d-4ea22dd1f5a6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:47.415685 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d1f81c6c-16f8-49cc-b76d-4ea22dd1f5a6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:47.416134 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d1f81c6c-16f8-49cc-b76d-4ea22dd1f5a6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:47.416559 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d1f81c6c-16f8-49cc-b76d-4ea22dd1f5a6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:47.429526 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-d1f81c6c-16f8-49cc-b76d-4ea22dd1f5a6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] HTTP exception thrown: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d1f81c6c-16f8-49cc-b76d-4ea22dd1f5a6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Request method failure captured: Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: DELETE /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 HTTP/1.1 Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EgqLFMVACCfMrY4J7ONHgYVvKlE4v1QQaBNNuJw33JDWgQa2db6oSCQWEEq_d_b3djeaziKxUdQ_9qQmAjT--Jhv1lA4NxTUfh9BHDtfniklooAXGTmTKdP-Y2X_3PJ23eoXVR642lr99fILTEz0z_dK9eEOKBdUHQzFw8agS4KWMI Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 477c661a08dd46b2a20f53a7944361ef Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:35:47.431050 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:35:47.432655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/477c661a08dd46b2a20f53a7944361ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_477c661a08dd46b2a20f53a7944361ef", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/477c661a08dd46b2a20f53a7944361ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/477c661a08dd46b2a20f53a7944361ef"}]}] Aug 04 22:35:47.432655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:47.432655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 477c661a08dd46b2a20f53a7944361ef Aug 04 22:35:47.432655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:47.432655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-AttachVolumeTestJSON-2021858786-project Aug 04 22:35:47.432655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:35:47.432655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:35:47.432655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 890f3e80ae37401f8dad15d3d084f091 Aug 04 22:35:47.432655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-AttachVolumeTestJSON-2021858786-project Aug 04 22:35:47.432655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:35:47.432655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:35:47.432655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '2baedf2f-2718-4cb2-a417-a230761f4002'} Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:35:47.433780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:35:47.435310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:47.436840 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d1f81c6c-16f8-49cc-b76d-4ea22dd1f5a6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Returning 404 to user: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:35:47.436840 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d1f81c6c-16f8-49cc-b76d-4ea22dd1f5a6 tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "DELETE /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 404 len: 111 microversion: 2.1 time: 0.030436 Aug 04 22:35:47.436840 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 599/1205] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:35:47 2022] DELETE /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:35:47.441191 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1ed836b2-c9fe-4ad8-ac91-dfc1cf11a47e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:47.441857 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1ed836b2-c9fe-4ad8-ac91-dfc1cf11a47e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] [instance: 2baedf2f-2718-4cb2-a417-a230761f4002] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:35:47.444329 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:47.450204 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1ed836b2-c9fe-4ad8-ac91-dfc1cf11a47e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:47.450688 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1ed836b2-c9fe-4ad8-ac91-dfc1cf11a47e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:47.451119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1ed836b2-c9fe-4ad8-ac91-dfc1cf11a47e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:47.451805 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1ed836b2-c9fe-4ad8-ac91-dfc1cf11a47e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:35:47.452252 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1ed836b2-c9fe-4ad8-ac91-dfc1cf11a47e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:35:47.452678 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1ed836b2-c9fe-4ad8-ac91-dfc1cf11a47e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:35:47.457990 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:47.467488 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-1ed836b2-c9fe-4ad8-ac91-dfc1cf11a47e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] HTTP exception thrown: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1ed836b2-c9fe-4ad8-ac91-dfc1cf11a47e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Request method failure captured: Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 HTTP/1.1 Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EgqLFMVACCfMrY4J7ONHgYVvKlE4v1QQaBNNuJw33JDWgQa2db6oSCQWEEq_d_b3djeaziKxUdQ_9qQmAjT--Jhv1lA4NxTUfh9BHDtfniklooAXGTmTKdP-Y2X_3PJ23eoXVR642lr99fILTEz0z_dK9eEOKBdUHQzFw8agS4KWMI Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 477c661a08dd46b2a20f53a7944361ef Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:35:47.469230 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:35:47.471022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/477c661a08dd46b2a20f53a7944361ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_477c661a08dd46b2a20f53a7944361ef", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/477c661a08dd46b2a20f53a7944361ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/477c661a08dd46b2a20f53a7944361ef"}]}] Aug 04 22:35:47.471022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:47.471022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 477c661a08dd46b2a20f53a7944361ef Aug 04 22:35:47.471022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2021858786 Aug 04 22:35:47.471022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-AttachVolumeTestJSON-2021858786-project Aug 04 22:35:47.471022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:35:47.471022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:35:47.471022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 890f3e80ae37401f8dad15d3d084f091 Aug 04 22:35:47.471022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-AttachVolumeTestJSON-2021858786-project Aug 04 22:35:47.471022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:35:47.471022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:35:47.471022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': '2baedf2f-2718-4cb2-a417-a230761f4002'} Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:35:47.471972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. Aug 04 22:35:47.473542 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:47.474915 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1ed836b2-c9fe-4ad8-ac91-dfc1cf11a47e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] Returning 404 to user: Instance 2baedf2f-2718-4cb2-a417-a230761f4002 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:35:47.474915 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1ed836b2-c9fe-4ad8-ac91-dfc1cf11a47e tempest-AttachVolumeTestJSON-2021858786 tempest-AttachVolumeTestJSON-2021858786-project] 10.222.0.109 "GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002" status: 404 len: 111 microversion: 2.1 time: 0.033763 Aug 04 22:35:47.474915 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 607/1206] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:35:47 2022] GET /compute/v2.1/servers/2baedf2f-2718-4cb2-a417-a230761f4002 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:35:51.798358 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bdb1a13e-914e-4c51-9611-0280a787af06 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Action: 'create', calling method: .version_select at 0x7fe7b60a2820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-855211510", "metadata": {"Type": "work"}}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bdb1a13e-914e-4c51-9611-0280a787af06 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Request method failure captured: Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 121 Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EnHYHU3OOeCs3T-sb55PyJknrBTR7dD_Apz2QqeXqSRbdNTbi9l5WgZzh5bxIQ10JAOsOjxTgmXXDk9ri2AOi447ZlwBchAMGOxZp2clyU-TbKPwKgkVvBadxvqa-QOXddW6HF5Orm6L0rlL6oYUlqdoQ46OQIZsvI3txh6AT2FaVI Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: ca463520f5b944f9adf111b2a46e0219 Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:35:51.821249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:35:51.823010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/ca463520f5b944f9adf111b2a46e0219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_ca463520f5b944f9adf111b2a46e0219", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ca463520f5b944f9adf111b2a46e0219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ca463520f5b944f9adf111b2a46e0219"}]}] Aug 04 22:35:51.823010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.823010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: ca463520f5b944f9adf111b2a46e0219 Aug 04 22:35:51.823010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.823010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-VolumesNegativeTest-1639836106-project Aug 04 22:35:51.823010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:35:51.823010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:35:51.823010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 9f5dd4aedaca4ad39979dfe294c87b40 Aug 04 22:35:51.823010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-VolumesNegativeTest-1639836106-project Aug 04 22:35:51.823010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Aug 04 22:35:51.823010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-855211510", "metadata": {"Type": "work"}}} Aug 04 22:35:51.823010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: Aug 04 22:35:51.823010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-855211510', 'metadata': {'Type': 'work'}}}} Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise error Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:35:51.823951 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 22:35:51.825629 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 22:35:51.826980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 22:35:51.826980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.826980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bdb1a13e-914e-4c51-9611-0280a787af06 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:35:51.826980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bdb1a13e-914e-4c51-9611-0280a787af06 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] 10.222.0.109 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.140695 Aug 04 22:35:51.826980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 600/1207] 10.222.0.109 () {60 vars in 1161 bytes} [Thu Aug 4 22:35:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 22:35:51.833024 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-83ef7a4e-a1d7-4b07-94db-7e5d1f1d03d9 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Action: 'create', calling method: .version_select at 0x7fe7b22cb940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-244728289", "metadata": {"Type": "work"}}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-83ef7a4e-a1d7-4b07-94db-7e5d1f1d03d9 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Request method failure captured: Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 119 Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EnHYHU3OOeCs3T-sb55PyJknrBTR7dD_Apz2QqeXqSRbdNTbi9l5WgZzh5bxIQ10JAOsOjxTgmXXDk9ri2AOi447ZlwBchAMGOxZp2clyU-TbKPwKgkVvBadxvqa-QOXddW6HF5Orm6L0rlL6oYUlqdoQ46OQIZsvI3txh6AT2FaVI Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: ca463520f5b944f9adf111b2a46e0219 Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:35:51.837799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:35:51.839381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/ca463520f5b944f9adf111b2a46e0219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_ca463520f5b944f9adf111b2a46e0219", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ca463520f5b944f9adf111b2a46e0219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ca463520f5b944f9adf111b2a46e0219"}]}] Aug 04 22:35:51.839381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.839381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: ca463520f5b944f9adf111b2a46e0219 Aug 04 22:35:51.839381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.839381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-VolumesNegativeTest-1639836106-project Aug 04 22:35:51.839381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:35:51.839381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:35:51.839381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 9f5dd4aedaca4ad39979dfe294c87b40 Aug 04 22:35:51.839381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-VolumesNegativeTest-1639836106-project Aug 04 22:35:51.839381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Aug 04 22:35:51.839381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-244728289", "metadata": {"Type": "work"}}} Aug 04 22:35:51.839381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: Aug 04 22:35:51.839381 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-244728289', 'metadata': {'Type': 'work'}}}} Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise error Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi '0' Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:35:51.840359 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 22:35:51.842007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 22:35:51.843218 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 22:35:51.843218 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.843218 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-83ef7a4e-a1d7-4b07-94db-7e5d1f1d03d9 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:35:51.843218 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-83ef7a4e-a1d7-4b07-94db-7e5d1f1d03d9 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] 10.222.0.109 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010227 Aug 04 22:35:51.843218 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 608/1208] 10.222.0.109 () {60 vars in 1161 bytes} [Thu Aug 4 22:35:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 22:35:51.849376 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bfeae80a-fee8-4705-92fb-3b631513b5aa tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Action: 'create', calling method: .version_select at 0x7fe7b186fee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1403661390", "metadata": {"Type": "work"}}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bfeae80a-fee8-4705-92fb-3b631513b5aa tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Request method failure captured: Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 119 Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EnHYHU3OOeCs3T-sb55PyJknrBTR7dD_Apz2QqeXqSRbdNTbi9l5WgZzh5bxIQ10JAOsOjxTgmXXDk9ri2AOi447ZlwBchAMGOxZp2clyU-TbKPwKgkVvBadxvqa-QOXddW6HF5Orm6L0rlL6oYUlqdoQ46OQIZsvI3txh6AT2FaVI Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: ca463520f5b944f9adf111b2a46e0219 Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:35:51.853010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:35:51.854706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/ca463520f5b944f9adf111b2a46e0219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_ca463520f5b944f9adf111b2a46e0219", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ca463520f5b944f9adf111b2a46e0219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ca463520f5b944f9adf111b2a46e0219"}]}] Aug 04 22:35:51.854706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.854706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: ca463520f5b944f9adf111b2a46e0219 Aug 04 22:35:51.854706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.854706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-VolumesNegativeTest-1639836106-project Aug 04 22:35:51.854706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:35:51.854706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:35:51.854706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 9f5dd4aedaca4ad39979dfe294c87b40 Aug 04 22:35:51.854706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-VolumesNegativeTest-1639836106-project Aug 04 22:35:51.854706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Aug 04 22:35:51.854706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1403661390", "metadata": {"Type": "work"}}} Aug 04 22:35:51.854706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: Aug 04 22:35:51.854706 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1403661390', 'metadata': {'Type': 'work'}}}} Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise error Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi '' Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:35:51.855651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 22:35:51.857346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 22:35:51.858835 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 22:35:51.858835 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.858835 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bfeae80a-fee8-4705-92fb-3b631513b5aa tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:35:51.858835 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bfeae80a-fee8-4705-92fb-3b631513b5aa tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] 10.222.0.109 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008782 Aug 04 22:35:51.858835 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 601/1209] 10.222.0.109 () {60 vars in 1161 bytes} [Thu Aug 4 22:35:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 22:35:51.865194 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a2e1c6d9-e786-4ff2-897b-d9b56a6f6368 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Calling method '.version_select at 0x7fe7b20b4280>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:51.895286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-a2e1c6d9-e786-4ff2-897b-d9b56a6f6368 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] HTTP exception thrown: Volume tempest-invalid-1248805294 could not be found. Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a2e1c6d9-e786-4ff2-897b-d9b56a6f6368 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Request method failure captured: Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1248805294 HTTP/1.1 Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EnHYHU3OOeCs3T-sb55PyJknrBTR7dD_Apz2QqeXqSRbdNTbi9l5WgZzh5bxIQ10JAOsOjxTgmXXDk9ri2AOi447ZlwBchAMGOxZp2clyU-TbKPwKgkVvBadxvqa-QOXddW6HF5Orm6L0rlL6oYUlqdoQ46OQIZsvI3txh6AT2FaVI Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: ca463520f5b944f9adf111b2a46e0219 Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:35:51.897246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:35:51.898908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/ca463520f5b944f9adf111b2a46e0219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_ca463520f5b944f9adf111b2a46e0219", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ca463520f5b944f9adf111b2a46e0219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ca463520f5b944f9adf111b2a46e0219"}]}] Aug 04 22:35:51.898908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.898908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: ca463520f5b944f9adf111b2a46e0219 Aug 04 22:35:51.898908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.898908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-VolumesNegativeTest-1639836106-project Aug 04 22:35:51.898908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:35:51.898908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:35:51.898908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 9f5dd4aedaca4ad39979dfe294c87b40 Aug 04 22:35:51.898908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-VolumesNegativeTest-1639836106-project Aug 04 22:35:51.898908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: Aug 04 22:35:51.898908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Volume tempest-invalid-1248805294 could not be found. Aug 04 22:35:51.898908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'tempest-invalid-1248805294'} Aug 04 22:35:51.898908 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1248805294 could not be found. (HTTP 404) (Request-ID: req-0fb4365a-1a9d-4117-bb76-bfe49857e83c) Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:51.899933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 22:35:51.901443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1248805294 could not be found. Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:35:51.902762 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1248805294 could not be found. Aug 04 22:35:51.904168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.904168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:51.904168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.904168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.904168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:51.904168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:51.904168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:35:51.904168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:35:51.904168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1248805294 could not be found. Aug 04 22:35:51.904168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.904168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a2e1c6d9-e786-4ff2-897b-d9b56a6f6368 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Returning 404 to user: Volume tempest-invalid-1248805294 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:35:51.904168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a2e1c6d9-e786-4ff2-897b-d9b56a6f6368 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] 10.222.0.109 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1248805294" status: 404 len: 99 microversion: 2.1 time: 0.038213 Aug 04 22:35:51.904168 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 609/1210] 10.222.0.109 () {58 vars in 1223 bytes} [Thu Aug 4 22:35:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1248805294 => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 22:35:51.910317 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f79f19ed-2e04-4ba7-9c52-4156704c85c0 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] 10.222.0.109 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004415 Aug 04 22:35:51.910810 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 602/1211] 10.222.0.109 () {58 vars in 1145 bytes} [Thu Aug 4 22:35:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 22:35:51.919015 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-81cdf10a-508a-452b-8ff7-3f7dfd8e1c58 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003634 Aug 04 22:35:51.919500 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 610/1212] 10.222.0.109 () {58 vars in 1142 bytes} [Thu Aug 4 22:35:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 22:35:51.927586 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4d75c360-7cf3-491e-890a-2f42e46be57c tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Calling method '.version_select at 0x7fe7b186fd30>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:51.956354 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-4d75c360-7cf3-491e-890a-2f42e46be57c tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] HTTP exception thrown: Volume 45c41a3e-c214-4680-8a31-a5e21d80a8c7 could not be found. Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4d75c360-7cf3-491e-890a-2f42e46be57c tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Request method failure captured: Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: DELETE /compute/v2.1/os-volumes/45c41a3e-c214-4680-8a31-a5e21d80a8c7 HTTP/1.1 Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EnHYHU3OOeCs3T-sb55PyJknrBTR7dD_Apz2QqeXqSRbdNTbi9l5WgZzh5bxIQ10JAOsOjxTgmXXDk9ri2AOi447ZlwBchAMGOxZp2clyU-TbKPwKgkVvBadxvqa-QOXddW6HF5Orm6L0rlL6oYUlqdoQ46OQIZsvI3txh6AT2FaVI Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: ca463520f5b944f9adf111b2a46e0219 Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:35:51.958611 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:35:51.960258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/ca463520f5b944f9adf111b2a46e0219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_ca463520f5b944f9adf111b2a46e0219", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ca463520f5b944f9adf111b2a46e0219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ca463520f5b944f9adf111b2a46e0219"}]}] Aug 04 22:35:51.960258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.960258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: ca463520f5b944f9adf111b2a46e0219 Aug 04 22:35:51.960258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:51.960258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-VolumesNegativeTest-1639836106-project Aug 04 22:35:51.960258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:35:51.960258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:35:51.960258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 9f5dd4aedaca4ad39979dfe294c87b40 Aug 04 22:35:51.960258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-VolumesNegativeTest-1639836106-project Aug 04 22:35:51.960258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: Aug 04 22:35:51.960258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Volume 45c41a3e-c214-4680-8a31-a5e21d80a8c7 could not be found. Aug 04 22:35:51.960258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '45c41a3e-c214-4680-8a31-a5e21d80a8c7'} Aug 04 22:35:51.960258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45c41a3e-c214-4680-8a31-a5e21d80a8c7 could not be found. (HTTP 404) (Request-ID: req-014fca55-a24b-48e7-945a-0ac64abb6665) Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:51.961188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 22:35:51.962682 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45c41a3e-c214-4680-8a31-a5e21d80a8c7 could not be found. Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 22:35:51.964011 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45c41a3e-c214-4680-8a31-a5e21d80a8c7 could not be found. Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45c41a3e-c214-4680-8a31-a5e21d80a8c7 could not be found. Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4d75c360-7cf3-491e-890a-2f42e46be57c tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Returning 404 to user: Volume 45c41a3e-c214-4680-8a31-a5e21d80a8c7 could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4d75c360-7cf3-491e-890a-2f42e46be57c tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] 10.222.0.109 "DELETE /compute/v2.1/os-volumes/45c41a3e-c214-4680-8a31-a5e21d80a8c7" status: 404 len: 109 microversion: 2.1 time: 0.035802 Aug 04 22:35:51.966905 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 603/1213] 10.222.0.109 () {58 vars in 1253 bytes} [Thu Aug 4 22:35:51 2022] DELETE /compute/v2.1/os-volumes/45c41a3e-c214-4680-8a31-a5e21d80a8c7 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:35:51.970767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-06eb15e9-5b8a-47d5-bf56-b068c9a48be5 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Calling method '.version_select at 0x7fe7b22cb160>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:35:51.998665 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-06eb15e9-5b8a-47d5-bf56-b068c9a48be5 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] HTTP exception thrown: Volume 79862703-4cb4-40e2-bfba-f962d16747bd could not be found. Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-06eb15e9-5b8a-47d5-bf56-b068c9a48be5 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Request method failure captured: Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/os-volumes/79862703-4cb4-40e2-bfba-f962d16747bd HTTP/1.1 Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7EnHYHU3OOeCs3T-sb55PyJknrBTR7dD_Apz2QqeXqSRbdNTbi9l5WgZzh5bxIQ10JAOsOjxTgmXXDk9ri2AOi447ZlwBchAMGOxZp2clyU-TbKPwKgkVvBadxvqa-QOXddW6HF5Orm6L0rlL6oYUlqdoQ46OQIZsvI3txh6AT2FaVI Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: ca463520f5b944f9adf111b2a46e0219 Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:35:52.001150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:35:52.002966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/ca463520f5b944f9adf111b2a46e0219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_ca463520f5b944f9adf111b2a46e0219", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ca463520f5b944f9adf111b2a46e0219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/ca463520f5b944f9adf111b2a46e0219"}]}] Aug 04 22:35:52.002966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:52.002966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: ca463520f5b944f9adf111b2a46e0219 Aug 04 22:35:52.002966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-VolumesNegativeTest-1639836106 Aug 04 22:35:52.002966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-VolumesNegativeTest-1639836106-project Aug 04 22:35:52.002966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:35:52.002966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:35:52.002966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 9f5dd4aedaca4ad39979dfe294c87b40 Aug 04 22:35:52.002966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-VolumesNegativeTest-1639836106-project Aug 04 22:35:52.002966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: Aug 04 22:35:52.002966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Volume 79862703-4cb4-40e2-bfba-f962d16747bd could not be found. Aug 04 22:35:52.002966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': '79862703-4cb4-40e2-bfba-f962d16747bd'} Aug 04 22:35:52.002966 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79862703-4cb4-40e2-bfba-f962d16747bd could not be found. (HTTP 404) (Request-ID: req-699b14a3-ed51-4eff-988a-0f46e4317bd5) Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:52.003914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 22:35:52.005141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79862703-4cb4-40e2-bfba-f962d16747bd could not be found. Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 22:35:52.007387 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79862703-4cb4-40e2-bfba-f962d16747bd could not be found. Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79862703-4cb4-40e2-bfba-f962d16747bd could not be found. Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-06eb15e9-5b8a-47d5-bf56-b068c9a48be5 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] Returning 404 to user: Volume 79862703-4cb4-40e2-bfba-f962d16747bd could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-06eb15e9-5b8a-47d5-bf56-b068c9a48be5 tempest-VolumesNegativeTest-1639836106 tempest-VolumesNegativeTest-1639836106-project] 10.222.0.109 "GET /compute/v2.1/os-volumes/79862703-4cb4-40e2-bfba-f962d16747bd" status: 404 len: 109 microversion: 2.1 time: 0.036847 Aug 04 22:35:52.008676 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 611/1214] 10.222.0.109 () {58 vars in 1250 bytes} [Thu Aug 4 22:35:51 2022] GET /compute/v2.1/os-volumes/79862703-4cb4-40e2-bfba-f962d16747bd => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:36:32.400264 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=3 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:32.401010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=3 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:32.405452 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-eaea3e6c-09ec-4e69-bedc-627d61542555 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Action: 'create', calling method: .version_select at 0x7fe7b17788b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-297183883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+Z42qHTh8XL/IZJKQMP84iQdK/J7nxxiRSwjvrHoBm4dVMnBEyzyUZn4u8derm7707ZfyYYj6s0Vd/avVoq3cSRK7nPNJaGza/ojHjUcRUqYHB/q/YwgdUUNAdK1G5Zw=="}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:36:32.422146 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-eaea3e6c-09ec-4e69-bedc-627d61542555 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Getting quotas for project 34dc6542be764622b304ee5f895041a2. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:36:32.426049 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-eaea3e6c-09ec-4e69-bedc-627d61542555 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Getting quotas for user 285c9f1fe752403fb7374b490391384e and project 34dc6542be764622b304ee5f895041a2. Resources: {'key_pairs'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:36:32.438474 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR oslo.messaging._drivers.impl_rabbit [None req-eaea3e6c-09ec-4e69-bedc-627d61542555 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [75aae9a9-a18d-4a44-a36f-beac2c320efa] AMQP server on 10.222.0.109:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 22:36:33.445868 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO oslo.messaging._drivers.impl_rabbit [None req-eaea3e6c-09ec-4e69-bedc-627d61542555 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [75aae9a9-a18d-4a44-a36f-beac2c320efa] Reconnected to AMQP server on 10.222.0.109:5672 via [amqp] client with port 36872. Aug 04 22:36:33.460795 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-eaea3e6c-09ec-4e69-bedc-627d61542555 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.061899 Aug 04 22:36:33.461397 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 604/1215] 10.222.0.109 () {60 vars in 1164 bytes} [Thu Aug 4 22:36:32 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:36:33.514297 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:33.515042 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:33.520018 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1015350661", "imageRef": "21844716-6f52-4810-8960-c3d44a238e84", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-297183883", "networks": [{"uuid": "b89fe14b-e78f-4248-b5b0-64e286008375"}]}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:36:33.571618 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.network.neutron [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] validate_networks() for [('b89fe14b-e78f-4248-b5b0-64e286008375', None, None, None, None, None)] {{(pid=129196) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:36:33.996999 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Flavor limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:36:33.997481 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Image limits 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:36:33.997985 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Flavor pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:36:33.998398 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Image pref 0:0:0 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:36:33.998869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.virt.hardware [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:36:34.007603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:34.008084 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:34.008517 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:34.009238 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:34.009713 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:34.010144 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:34.027954 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Getting quotas for project 34dc6542be764622b304ee5f895041a2. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:36:34.032036 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.quota [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Getting quotas for user 285c9f1fe752403fb7374b490391384e and project 34dc6542be764622b304ee5f895041a2. Resources: {'ram', 'cores', 'instances'} {{(pid=129196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:36:34.042898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Going to run 1 instances... {{(pid=129196) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:36:34.045799 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21844716-6f52-4810-8960-c3d44a238e84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:36:34.092255 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-44a7d41a-1467-449e-aa3e-2e94d3df7425 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.579366 Aug 04 22:36:34.092901 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 612/1216] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:36:33 2022] POST /compute/v2.1/servers => generated 382 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:36:34.104187 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-a8fcf1d7-cd2a-4842-8bcf-64b532edc865 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:34.105184 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-a8fcf1d7-cd2a-4842-8bcf-64b532edc865 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:34.163662 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-a8fcf1d7-cd2a-4842-8bcf-64b532edc865 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:34.171067 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-a8fcf1d7-cd2a-4842-8bcf-64b532edc865 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1262 microversion: 2.1 time: 0.071603 Aug 04 22:36:34.172077 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 605/1217] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:34 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:35.192597 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a7184aa0-c7b0-4030-b636-c506cb248e14 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:35.193206 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a7184aa0-c7b0-4030-b636-c506cb248e14 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:35.200158 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7184aa0-c7b0-4030-b636-c506cb248e14 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:35.200643 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7184aa0-c7b0-4030-b636-c506cb248e14 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:35.201072 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7184aa0-c7b0-4030-b636-c506cb248e14 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:35.201809 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7184aa0-c7b0-4030-b636-c506cb248e14 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:35.202255 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7184aa0-c7b0-4030-b636-c506cb248e14 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:35.202673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a7184aa0-c7b0-4030-b636-c506cb248e14 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:35.279422 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a7184aa0-c7b0-4030-b636-c506cb248e14 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:35.287155 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a7184aa0-c7b0-4030-b636-c506cb248e14 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1322 microversion: 2.1 time: 0.098857 Aug 04 22:36:35.291795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 613/1218] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:35 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1322 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:36.309620 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-c73da7f7-66c7-42e7-b317-3fdcbf62ecbc tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:36.310248 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-c73da7f7-66c7-42e7-b317-3fdcbf62ecbc tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:36.317618 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c73da7f7-66c7-42e7-b317-3fdcbf62ecbc tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:36.318111 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c73da7f7-66c7-42e7-b317-3fdcbf62ecbc tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:36.318741 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c73da7f7-66c7-42e7-b317-3fdcbf62ecbc tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:36.319656 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c73da7f7-66c7-42e7-b317-3fdcbf62ecbc tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:36.320117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c73da7f7-66c7-42e7-b317-3fdcbf62ecbc tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:36.320572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-c73da7f7-66c7-42e7-b317-3fdcbf62ecbc tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:36.463270 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-c73da7f7-66c7-42e7-b317-3fdcbf62ecbc tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:36.470856 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-c73da7f7-66c7-42e7-b317-3fdcbf62ecbc tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.165300 Aug 04 22:36:36.471424 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 606/1219] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:36 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:37.492364 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b0fb403c-224a-437d-b0a4-e7140c1c3523 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:37.492916 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b0fb403c-224a-437d-b0a4-e7140c1c3523 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:37.500119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0fb403c-224a-437d-b0a4-e7140c1c3523 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:37.500599 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0fb403c-224a-437d-b0a4-e7140c1c3523 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:37.501029 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0fb403c-224a-437d-b0a4-e7140c1c3523 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:37.501752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0fb403c-224a-437d-b0a4-e7140c1c3523 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:37.502198 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0fb403c-224a-437d-b0a4-e7140c1c3523 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:37.502617 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b0fb403c-224a-437d-b0a4-e7140c1c3523 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:37.642708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b0fb403c-224a-437d-b0a4-e7140c1c3523 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:37.650398 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b0fb403c-224a-437d-b0a4-e7140c1c3523 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.161928 Aug 04 22:36:37.650972 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 614/1220] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:37 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:38.672885 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-593c364d-20b7-4fab-a4dc-fe56ce65a74c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:38.673675 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-593c364d-20b7-4fab-a4dc-fe56ce65a74c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:38.680168 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-593c364d-20b7-4fab-a4dc-fe56ce65a74c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:38.680649 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-593c364d-20b7-4fab-a4dc-fe56ce65a74c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:38.681077 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-593c364d-20b7-4fab-a4dc-fe56ce65a74c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:38.681793 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-593c364d-20b7-4fab-a4dc-fe56ce65a74c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:38.682272 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-593c364d-20b7-4fab-a4dc-fe56ce65a74c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:38.682688 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-593c364d-20b7-4fab-a4dc-fe56ce65a74c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:38.822195 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-593c364d-20b7-4fab-a4dc-fe56ce65a74c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:38.832254 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-593c364d-20b7-4fab-a4dc-fe56ce65a74c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.163555 Aug 04 22:36:38.833227 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 607/1221] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:38 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:39.852688 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7ebc2180-e9bf-4072-96dd-0b005f0f18d0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:39.853810 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7ebc2180-e9bf-4072-96dd-0b005f0f18d0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:39.862212 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7ebc2180-e9bf-4072-96dd-0b005f0f18d0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:39.862795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7ebc2180-e9bf-4072-96dd-0b005f0f18d0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:39.863303 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7ebc2180-e9bf-4072-96dd-0b005f0f18d0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:39.864110 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7ebc2180-e9bf-4072-96dd-0b005f0f18d0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:39.864677 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7ebc2180-e9bf-4072-96dd-0b005f0f18d0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:39.865110 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7ebc2180-e9bf-4072-96dd-0b005f0f18d0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:40.007066 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7ebc2180-e9bf-4072-96dd-0b005f0f18d0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:40.015456 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7ebc2180-e9bf-4072-96dd-0b005f0f18d0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.166513 Aug 04 22:36:40.026173 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 615/1222] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:39 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:41.038000 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-58c82a8c-8974-4e5f-9252-c48b6d7b97e7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:41.038630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-58c82a8c-8974-4e5f-9252-c48b6d7b97e7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:41.045702 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58c82a8c-8974-4e5f-9252-c48b6d7b97e7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:41.046502 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58c82a8c-8974-4e5f-9252-c48b6d7b97e7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:41.047004 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58c82a8c-8974-4e5f-9252-c48b6d7b97e7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:41.047785 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58c82a8c-8974-4e5f-9252-c48b6d7b97e7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:41.048310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58c82a8c-8974-4e5f-9252-c48b6d7b97e7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:41.048804 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-58c82a8c-8974-4e5f-9252-c48b6d7b97e7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:41.187832 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-58c82a8c-8974-4e5f-9252-c48b6d7b97e7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:41.202865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-58c82a8c-8974-4e5f-9252-c48b6d7b97e7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.168700 Aug 04 22:36:41.203444 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 608/1223] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:41 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:41.887667 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a18ca311-68b3-4804-a6ad-afa6de472b28 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:41.888819 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a18ca311-68b3-4804-a6ad-afa6de472b28 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:41.895865 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a18ca311-68b3-4804-a6ad-afa6de472b28 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:41.896351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a18ca311-68b3-4804-a6ad-afa6de472b28 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:41.896814 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a18ca311-68b3-4804-a6ad-afa6de472b28 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:41.897513 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a18ca311-68b3-4804-a6ad-afa6de472b28 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:41.897960 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a18ca311-68b3-4804-a6ad-afa6de472b28 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:41.898380 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a18ca311-68b3-4804-a6ad-afa6de472b28 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:41.927802 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a18ca311-68b3-4804-a6ad-afa6de472b28 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Going to try to terminate instance {{(pid=129196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:36:42.015342 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a18ca311-68b3-4804-a6ad-afa6de472b28 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "DELETE /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 204 len: 0 microversion: 2.1 time: 0.131107 Aug 04 22:36:42.020247 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 616/1224] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:36:41 2022] DELETE /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 22:36:42.024841 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2ea5e9df-0bed-47f5-ad02-1ac777948811 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:42.025491 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2ea5e9df-0bed-47f5-ad02-1ac777948811 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:42.033101 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2ea5e9df-0bed-47f5-ad02-1ac777948811 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:42.033678 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2ea5e9df-0bed-47f5-ad02-1ac777948811 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:42.034196 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2ea5e9df-0bed-47f5-ad02-1ac777948811 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:42.035169 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2ea5e9df-0bed-47f5-ad02-1ac777948811 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:42.035646 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2ea5e9df-0bed-47f5-ad02-1ac777948811 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:42.036138 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2ea5e9df-0bed-47f5-ad02-1ac777948811 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:42.182240 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2ea5e9df-0bed-47f5-ad02-1ac777948811 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:42.190583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2ea5e9df-0bed-47f5-ad02-1ac777948811 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1581 microversion: 2.1 time: 0.169390 Aug 04 22:36:42.191447 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 609/1225] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:42 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1581 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:42.224706 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-618676ba-5ac4-45b2-8300-46f1ae00a943 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:42.225401 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-618676ba-5ac4-45b2-8300-46f1ae00a943 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:42.232107 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-618676ba-5ac4-45b2-8300-46f1ae00a943 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:42.232592 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-618676ba-5ac4-45b2-8300-46f1ae00a943 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:42.233026 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-618676ba-5ac4-45b2-8300-46f1ae00a943 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:42.233802 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-618676ba-5ac4-45b2-8300-46f1ae00a943 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:42.234259 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-618676ba-5ac4-45b2-8300-46f1ae00a943 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:42.234681 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-618676ba-5ac4-45b2-8300-46f1ae00a943 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:42.378464 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-618676ba-5ac4-45b2-8300-46f1ae00a943 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:42.387558 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-618676ba-5ac4-45b2-8300-46f1ae00a943 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.166988 Aug 04 22:36:42.389123 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 617/1226] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:42 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:43.212109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-33da5864-dad9-482e-b583-ec91f07198e6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:43.212754 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-33da5864-dad9-482e-b583-ec91f07198e6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:43.220589 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-33da5864-dad9-482e-b583-ec91f07198e6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:43.221087 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-33da5864-dad9-482e-b583-ec91f07198e6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:43.221566 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-33da5864-dad9-482e-b583-ec91f07198e6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:43.222300 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-33da5864-dad9-482e-b583-ec91f07198e6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:43.222748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-33da5864-dad9-482e-b583-ec91f07198e6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:43.223177 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-33da5864-dad9-482e-b583-ec91f07198e6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:43.362191 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-33da5864-dad9-482e-b583-ec91f07198e6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:43.370095 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-33da5864-dad9-482e-b583-ec91f07198e6 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1581 microversion: 2.1 time: 0.161941 Aug 04 22:36:43.371238 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 610/1227] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:43 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1581 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:43.408279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c59fe8d2-7f2c-4cd3-833e-82646d607cb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:43.408973 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c59fe8d2-7f2c-4cd3-833e-82646d607cb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:43.415673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c59fe8d2-7f2c-4cd3-833e-82646d607cb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:43.416155 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c59fe8d2-7f2c-4cd3-833e-82646d607cb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:43.416605 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c59fe8d2-7f2c-4cd3-833e-82646d607cb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:43.417925 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c59fe8d2-7f2c-4cd3-833e-82646d607cb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:43.418394 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c59fe8d2-7f2c-4cd3-833e-82646d607cb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:43.418903 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c59fe8d2-7f2c-4cd3-833e-82646d607cb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:43.557491 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c59fe8d2-7f2c-4cd3-833e-82646d607cb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:43.565692 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c59fe8d2-7f2c-4cd3-833e-82646d607cb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.161129 Aug 04 22:36:43.566270 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 618/1228] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:43 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:44.392088 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-2f0b6484-0c68-43a6-847e-dd1993cbc250 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:44.392647 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-2f0b6484-0c68-43a6-847e-dd1993cbc250 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:44.394518 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=6 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:44.400639 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2f0b6484-0c68-43a6-847e-dd1993cbc250 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:44.401121 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2f0b6484-0c68-43a6-847e-dd1993cbc250 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:44.402318 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2f0b6484-0c68-43a6-847e-dd1993cbc250 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:44.403063 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2f0b6484-0c68-43a6-847e-dd1993cbc250 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:44.403525 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2f0b6484-0c68-43a6-847e-dd1993cbc250 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:44.403950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-2f0b6484-0c68-43a6-847e-dd1993cbc250 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:44.537555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-2f0b6484-0c68-43a6-847e-dd1993cbc250 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:44.545769 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-2f0b6484-0c68-43a6-847e-dd1993cbc250 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1581 microversion: 2.1 time: 0.157591 Aug 04 22:36:44.546337 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 611/1229] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:44 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1581 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:44.587062 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-332c80ef-5267-4b81-bac7-5f3a93915c34 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:44.587947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-332c80ef-5267-4b81-bac7-5f3a93915c34 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:44.590378 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:44.591395 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=6 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:44.597600 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-332c80ef-5267-4b81-bac7-5f3a93915c34 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:44.598083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-332c80ef-5267-4b81-bac7-5f3a93915c34 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:44.598511 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-332c80ef-5267-4b81-bac7-5f3a93915c34 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:44.599201 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-332c80ef-5267-4b81-bac7-5f3a93915c34 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:44.599650 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-332c80ef-5267-4b81-bac7-5f3a93915c34 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:44.600069 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-332c80ef-5267-4b81-bac7-5f3a93915c34 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:44.727468 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-332c80ef-5267-4b81-bac7-5f3a93915c34 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:44.735670 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-332c80ef-5267-4b81-bac7-5f3a93915c34 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.152492 Aug 04 22:36:44.736245 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 619/1230] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:44 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:45.566992 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-20edca7f-c114-47e0-9db3-e413eed1f722 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:45.567609 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-20edca7f-c114-47e0-9db3-e413eed1f722 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:45.573977 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20edca7f-c114-47e0-9db3-e413eed1f722 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:45.574463 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20edca7f-c114-47e0-9db3-e413eed1f722 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:45.574896 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20edca7f-c114-47e0-9db3-e413eed1f722 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:45.575587 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20edca7f-c114-47e0-9db3-e413eed1f722 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:45.576043 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20edca7f-c114-47e0-9db3-e413eed1f722 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:45.576471 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-20edca7f-c114-47e0-9db3-e413eed1f722 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:45.707763 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-20edca7f-c114-47e0-9db3-e413eed1f722 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:45.716362 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-20edca7f-c114-47e0-9db3-e413eed1f722 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1581 microversion: 2.1 time: 0.153349 Aug 04 22:36:45.717196 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 612/1231] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:45 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1581 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:45.757903 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-de108e08-72b9-4e74-9400-2f151b4871a7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:45.758518 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-de108e08-72b9-4e74-9400-2f151b4871a7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:45.764933 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de108e08-72b9-4e74-9400-2f151b4871a7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:45.765435 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de108e08-72b9-4e74-9400-2f151b4871a7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:45.765879 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de108e08-72b9-4e74-9400-2f151b4871a7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:45.766569 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de108e08-72b9-4e74-9400-2f151b4871a7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:45.767020 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de108e08-72b9-4e74-9400-2f151b4871a7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:45.767492 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-de108e08-72b9-4e74-9400-2f151b4871a7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:45.892338 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-de108e08-72b9-4e74-9400-2f151b4871a7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:45.899690 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-de108e08-72b9-4e74-9400-2f151b4871a7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.145591 Aug 04 22:36:45.900255 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 620/1232] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:45 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:36:46.738044 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3d1e020c-5e63-468c-9ee2-a0c95fffef7d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:46.738776 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3d1e020c-5e63-468c-9ee2-a0c95fffef7d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:46.745437 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3d1e020c-5e63-468c-9ee2-a0c95fffef7d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:46.746000 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3d1e020c-5e63-468c-9ee2-a0c95fffef7d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:46.746444 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3d1e020c-5e63-468c-9ee2-a0c95fffef7d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:46.747133 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3d1e020c-5e63-468c-9ee2-a0c95fffef7d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:46.747584 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3d1e020c-5e63-468c-9ee2-a0c95fffef7d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:46.748000 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3d1e020c-5e63-468c-9ee2-a0c95fffef7d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:46.880373 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-9cfe0913-f06b-4a17-885a-f28c0b43aaba req-0f8d4f9b-6967-4247-ba62-f1219c2aa764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e046be-ac38-431d-94a6-cc0857be49cc", "tag": "f0e67f32-c3b1-4fa5-85b0-9006d13726ee"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:36:46.885581 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3d1e020c-5e63-468c-9ee2-a0c95fffef7d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:46.893929 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3d1e020c-5e63-468c-9ee2-a0c95fffef7d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1581 microversion: 2.1 time: 0.159464 Aug 04 22:36:46.894516 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 613/1233] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:46 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1581 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:46.896683 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-9cfe0913-f06b-4a17-885a-f28c0b43aaba req-0f8d4f9b-6967-4247-ba62-f1219c2aa764 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:46.897166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-9cfe0913-f06b-4a17-885a-f28c0b43aaba req-0f8d4f9b-6967-4247-ba62-f1219c2aa764 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:46.897623 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-9cfe0913-f06b-4a17-885a-f28c0b43aaba req-0f8d4f9b-6967-4247-ba62-f1219c2aa764 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:46.914577 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-9cfe0913-f06b-4a17-885a-f28c0b43aaba req-0f8d4f9b-6967-4247-ba62-f1219c2aa764 service nova] Creating event network-changed:f0e67f32-c3b1-4fa5-85b0-9006d13726ee for instance d3e046be-ac38-431d-94a6-cc0857be49cc on hv-cinder-85221 Aug 04 22:36:46.922114 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-9cfe0913-f06b-4a17-885a-f28c0b43aaba req-0f8d4f9b-6967-4247-ba62-f1219c2aa764 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045210 Aug 04 22:36:46.922854 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f32b694e-69f0-47c2-b8be-2a9c928311b7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:46.923039 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 621/1234] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:36:46.923908 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f32b694e-69f0-47c2-b8be-2a9c928311b7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:46.929992 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f32b694e-69f0-47c2-b8be-2a9c928311b7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:46.930456 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f32b694e-69f0-47c2-b8be-2a9c928311b7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:46.930897 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f32b694e-69f0-47c2-b8be-2a9c928311b7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:46.931604 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f32b694e-69f0-47c2-b8be-2a9c928311b7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:46.932063 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f32b694e-69f0-47c2-b8be-2a9c928311b7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:46.932490 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f32b694e-69f0-47c2-b8be-2a9c928311b7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:47.063477 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-f32b694e-69f0-47c2-b8be-2a9c928311b7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:47.070839 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f32b694e-69f0-47c2-b8be-2a9c928311b7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.152763 Aug 04 22:36:47.071399 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 614/1235] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:46 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:36:47.916300 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-64825b2f-5337-4941-a1a5-dc1e30eb8b79 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:47.918002 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-64825b2f-5337-4941-a1a5-dc1e30eb8b79 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:47.924192 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-64825b2f-5337-4941-a1a5-dc1e30eb8b79 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:47.924675 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-64825b2f-5337-4941-a1a5-dc1e30eb8b79 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:47.925134 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-64825b2f-5337-4941-a1a5-dc1e30eb8b79 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:47.925856 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-64825b2f-5337-4941-a1a5-dc1e30eb8b79 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:47.926311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-64825b2f-5337-4941-a1a5-dc1e30eb8b79 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:47.926733 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-64825b2f-5337-4941-a1a5-dc1e30eb8b79 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:48.064485 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-64825b2f-5337-4941-a1a5-dc1e30eb8b79 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:48.072084 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-64825b2f-5337-4941-a1a5-dc1e30eb8b79 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1581 microversion: 2.1 time: 0.160513 Aug 04 22:36:48.072651 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 622/1236] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:47 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1581 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:48.092486 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-00d9650a-887f-474c-9406-ef50bae57024 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:48.093095 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-00d9650a-887f-474c-9406-ef50bae57024 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:48.099511 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-00d9650a-887f-474c-9406-ef50bae57024 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:48.099992 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-00d9650a-887f-474c-9406-ef50bae57024 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:48.100428 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-00d9650a-887f-474c-9406-ef50bae57024 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:48.101120 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-00d9650a-887f-474c-9406-ef50bae57024 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:48.101617 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-00d9650a-887f-474c-9406-ef50bae57024 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:48.102042 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-00d9650a-887f-474c-9406-ef50bae57024 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:48.236350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-00d9650a-887f-474c-9406-ef50bae57024 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:48.244275 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-00d9650a-887f-474c-9406-ef50bae57024 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.156033 Aug 04 22:36:48.244867 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 615/1237] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:48 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:49.094502 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-2969fbae-8226-46fb-8465-ed767b6d7993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:49.095188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-2969fbae-8226-46fb-8465-ed767b6d7993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:49.116043 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2969fbae-8226-46fb-8465-ed767b6d7993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:49.116552 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2969fbae-8226-46fb-8465-ed767b6d7993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:49.116990 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2969fbae-8226-46fb-8465-ed767b6d7993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:49.118470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2969fbae-8226-46fb-8465-ed767b6d7993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:49.118932 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2969fbae-8226-46fb-8465-ed767b6d7993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:49.119364 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2969fbae-8226-46fb-8465-ed767b6d7993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:49.138097 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-82159941-e122-4cc6-b6a6-d3998a465b6e req-00394da0-da9d-4023-b65d-8027f821e448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6", "name": "network-vif-deleted", "tag": "b95d5420-6dc0-4b63-ac13-7bf8cba30d67"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:36:49.148777 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-82159941-e122-4cc6-b6a6-d3998a465b6e req-00394da0-da9d-4023-b65d-8027f821e448 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:49.149260 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-82159941-e122-4cc6-b6a6-d3998a465b6e req-00394da0-da9d-4023-b65d-8027f821e448 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:49.149721 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-82159941-e122-4cc6-b6a6-d3998a465b6e req-00394da0-da9d-4023-b65d-8027f821e448 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:49.163845 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-82159941-e122-4cc6-b6a6-d3998a465b6e req-00394da0-da9d-4023-b65d-8027f821e448 service nova] Creating event network-vif-deleted:b95d5420-6dc0-4b63-ac13-7bf8cba30d67 for instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 on hv-cinder-85221 Aug 04 22:36:49.175565 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-82159941-e122-4cc6-b6a6-d3998a465b6e req-00394da0-da9d-4023-b65d-8027f821e448 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041159 Aug 04 22:36:49.176631 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 616/1238] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:36:49.191375 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2969fbae-8226-46fb-8465-ed767b6d7993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:49.200627 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-2969fbae-8226-46fb-8465-ed767b6d7993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1513 microversion: 2.1 time: 0.110735 Aug 04 22:36:49.201573 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 623/1239] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:49 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1513 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:49.266267 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b1549980-2e80-4a46-b33d-f1f1be6dff41 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:49.267162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b1549980-2e80-4a46-b33d-f1f1be6dff41 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:49.273839 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1549980-2e80-4a46-b33d-f1f1be6dff41 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:49.274337 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1549980-2e80-4a46-b33d-f1f1be6dff41 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:49.274777 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1549980-2e80-4a46-b33d-f1f1be6dff41 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:49.275498 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1549980-2e80-4a46-b33d-f1f1be6dff41 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:49.275954 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1549980-2e80-4a46-b33d-f1f1be6dff41 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:49.277185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1549980-2e80-4a46-b33d-f1f1be6dff41 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:49.416257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b1549980-2e80-4a46-b33d-f1f1be6dff41 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:49.423889 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b1549980-2e80-4a46-b33d-f1f1be6dff41 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.161851 Aug 04 22:36:49.424455 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 617/1240] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:49 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:50.222603 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e5ed17a5-fc24-4fe0-ba6a-a3bd79c40af8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:50.223211 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e5ed17a5-fc24-4fe0-ba6a-a3bd79c40af8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:50.229804 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e5ed17a5-fc24-4fe0-ba6a-a3bd79c40af8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:50.230342 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e5ed17a5-fc24-4fe0-ba6a-a3bd79c40af8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:50.230773 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e5ed17a5-fc24-4fe0-ba6a-a3bd79c40af8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:50.231495 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e5ed17a5-fc24-4fe0-ba6a-a3bd79c40af8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:50.231957 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e5ed17a5-fc24-4fe0-ba6a-a3bd79c40af8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:50.232385 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e5ed17a5-fc24-4fe0-ba6a-a3bd79c40af8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:50.298942 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-e5ed17a5-fc24-4fe0-ba6a-a3bd79c40af8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:50.307146 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e5ed17a5-fc24-4fe0-ba6a-a3bd79c40af8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1513 microversion: 2.1 time: 0.088439 Aug 04 22:36:50.307719 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 624/1241] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:50 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1513 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:50.444283 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-458b7988-5e93-4099-9a65-0a6693c85e3e tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:50.444941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-458b7988-5e93-4099-9a65-0a6693c85e3e tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:50.451911 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-458b7988-5e93-4099-9a65-0a6693c85e3e tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:50.452399 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-458b7988-5e93-4099-9a65-0a6693c85e3e tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:50.452838 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-458b7988-5e93-4099-9a65-0a6693c85e3e tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:50.453571 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-458b7988-5e93-4099-9a65-0a6693c85e3e tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:50.454298 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-458b7988-5e93-4099-9a65-0a6693c85e3e tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:50.454726 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-458b7988-5e93-4099-9a65-0a6693c85e3e tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:50.584185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-458b7988-5e93-4099-9a65-0a6693c85e3e tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:50.591847 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-458b7988-5e93-4099-9a65-0a6693c85e3e tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.151367 Aug 04 22:36:50.592419 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 618/1242] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:50 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:51.328522 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:51.329324 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:51.335831 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:51.336319 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:51.336752 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:51.337469 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:51.337923 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:51.338347 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:51.370572 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:51.371082 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:51.371520 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:51.371962 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lazy-loading 'fault' on Instance uuid 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:36:51.411431 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:51.419258 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7d95a7a9-c4b1-4883-b667-dd3fb36a840e tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 200 len: 1234 microversion: 2.1 time: 0.094629 Aug 04 22:36:51.419821 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 625/1243] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:51 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 1234 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:51.612046 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-adf13678-9968-4186-97a9-f51ec9c54fb7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:51.612740 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-adf13678-9968-4186-97a9-f51ec9c54fb7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:51.620465 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-adf13678-9968-4186-97a9-f51ec9c54fb7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:51.621178 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-adf13678-9968-4186-97a9-f51ec9c54fb7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:51.621983 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-adf13678-9968-4186-97a9-f51ec9c54fb7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:51.622703 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-adf13678-9968-4186-97a9-f51ec9c54fb7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:51.623188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-adf13678-9968-4186-97a9-f51ec9c54fb7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:51.623610 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-adf13678-9968-4186-97a9-f51ec9c54fb7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:51.777633 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-adf13678-9968-4186-97a9-f51ec9c54fb7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:51.785027 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-adf13678-9968-4186-97a9-f51ec9c54fb7 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.176839 Aug 04 22:36:51.785628 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 619/1244] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:51 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:52.441279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7c91ff77-b212-4f95-a6a5-434273f38576 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:52.442007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7c91ff77-b212-4f95-a6a5-434273f38576 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:52.448967 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7c91ff77-b212-4f95-a6a5-434273f38576 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:52.449465 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7c91ff77-b212-4f95-a6a5-434273f38576 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:52.449910 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7c91ff77-b212-4f95-a6a5-434273f38576 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:52.450606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7c91ff77-b212-4f95-a6a5-434273f38576 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:52.451060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7c91ff77-b212-4f95-a6a5-434273f38576 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:52.451491 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7c91ff77-b212-4f95-a6a5-434273f38576 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:52.465648 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-7c91ff77-b212-4f95-a6a5-434273f38576 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] HTTP exception thrown: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7c91ff77-b212-4f95-a6a5-434273f38576 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Request method failure captured: Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 HTTP/1.1 Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7ElD_3ntrMeTQ6nqkQO0ZKs5Bh4rc9U5lsNxGAdK9rAI0Rac0CNBwJCjJnUkHL4sl5Ri7rv7DOVHXDrhEi_0-xs_KxUBkRkoMbF6qP-pTgeFAE7JirAXh4BKegMRfm7yDkVzv7GFFTfEb-5Iz5NOvDVAu37_dBU_4IGM6MU5KZU6l4Y Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 49576f2166cc4b7f9261bd7cbc8384f4 Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:36:52.467279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:36:52.469119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/49576f2166cc4b7f9261bd7cbc8384f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_49576f2166cc4b7f9261bd7cbc8384f4", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/49576f2166cc4b7f9261bd7cbc8384f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/49576f2166cc4b7f9261bd7cbc8384f4"}]}] Aug 04 22:36:52.469119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:36:52.469119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 49576f2166cc4b7f9261bd7cbc8384f4 Aug 04 22:36:52.469119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:36:52.469119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-TestVolumeBootPattern-1400051087-project Aug 04 22:36:52.469119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:36:52.469119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:36:52.469119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 43e543cfa3e1402e9694dcb095a26c00 Aug 04 22:36:52.469119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-TestVolumeBootPattern-1400051087-project Aug 04 22:36:52.469119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:36:52.469119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:36:52.469119 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': '7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6'} Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:36:52.470299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:36:52.471750 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:36:52.473141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7c91ff77-b212-4f95-a6a5-434273f38576 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Returning 404 to user: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:36:52.473141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7c91ff77-b212-4f95-a6a5-434273f38576 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 404 len: 111 microversion: 2.1 time: 0.031308 Aug 04 22:36:52.473141 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 626/1245] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:52 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:36:52.564066 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-739904494", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1818150918", "security_groups": [{"name": "tempest-secgroup-smoke-1118840594"}], "block_device_mapping_v2": [{"uuid": "4027ba0a-416f-42b3-ab63-4796033fbf28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94e914cb-0766-4758-bbaa-283c7e48c0dc"}]}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:36:52.677382 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.network.neutron [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] validate_networks() for [('94e914cb-0766-4758-bbaa-283c7e48c0dc', None, None, None, None, None)] {{(pid=129197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:36:52.805930 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-65d64ea2-b9dd-4c1a-8eb5-678f04bc8eb0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:52.806635 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-65d64ea2-b9dd-4c1a-8eb5-678f04bc8eb0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:52.813456 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-65d64ea2-b9dd-4c1a-8eb5-678f04bc8eb0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:52.814078 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-65d64ea2-b9dd-4c1a-8eb5-678f04bc8eb0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:52.814474 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-65d64ea2-b9dd-4c1a-8eb5-678f04bc8eb0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:52.815222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-65d64ea2-b9dd-4c1a-8eb5-678f04bc8eb0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:52.815634 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-65d64ea2-b9dd-4c1a-8eb5-678f04bc8eb0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:52.816091 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-65d64ea2-b9dd-4c1a-8eb5-678f04bc8eb0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:52.947126 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-65d64ea2-b9dd-4c1a-8eb5-678f04bc8eb0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:52.955470 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-65d64ea2-b9dd-4c1a-8eb5-678f04bc8eb0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.153332 Aug 04 22:36:52.956048 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 627/1246] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:52 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:36:53.048939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Flavor limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:36:53.049366 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Image limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:36:53.049880 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Flavor pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:36:53.050291 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Image pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:36:53.050732 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:36:53.060382 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:53.060871 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:53.061307 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:53.062064 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:53.062520 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:53.062945 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:53.080142 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Getting quotas for project 49576f2166cc4b7f9261bd7cbc8384f4. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:36:53.084061 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Getting quotas for user 43e543cfa3e1402e9694dcb095a26c00 and project 49576f2166cc4b7f9261bd7cbc8384f4. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:36:53.141818 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Going to run 1 instances... {{(pid=129197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:36:53.143927 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4027ba0a-416f-42b3-ab63-4796033fbf28',volume_size=None,volume_type=None)] {{(pid=129197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:36:53.271627 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR oslo.messaging._drivers.impl_rabbit [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [0ac3e1e0-11e9-49f1-b167-e34ee4ded995] AMQP server on 10.222.0.109:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 22:36:53.770207 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-e7e4dc46-caba-4823-9020-f1b3930caa77 req-b04eba61-1e72-4955-b97e-0ab304a37e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e046be-ac38-431d-94a6-cc0857be49cc", "name": "network-vif-plugged", "status": "completed", "tag": "f0e67f32-c3b1-4fa5-85b0-9006d13726ee"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:36:53.779652 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-e7e4dc46-caba-4823-9020-f1b3930caa77 req-b04eba61-1e72-4955-b97e-0ab304a37e66 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:53.780123 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-e7e4dc46-caba-4823-9020-f1b3930caa77 req-b04eba61-1e72-4955-b97e-0ab304a37e66 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:53.780558 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-e7e4dc46-caba-4823-9020-f1b3930caa77 req-b04eba61-1e72-4955-b97e-0ab304a37e66 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:53.791225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-e7e4dc46-caba-4823-9020-f1b3930caa77 req-b04eba61-1e72-4955-b97e-0ab304a37e66 service nova] Creating event network-vif-plugged:f0e67f32-c3b1-4fa5-85b0-9006d13726ee for instance d3e046be-ac38-431d-94a6-cc0857be49cc on hv-cinder-85221 Aug 04 22:36:53.796798 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-e7e4dc46-caba-4823-9020-f1b3930caa77 req-b04eba61-1e72-4955-b97e-0ab304a37e66 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154873 Aug 04 22:36:53.797372 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 628/1247] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:36:53.977078 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-9404ac99-0c73-4db4-873d-e4fa0257cac0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:53.977977 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-9404ac99-0c73-4db4-873d-e4fa0257cac0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:53.985715 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9404ac99-0c73-4db4-873d-e4fa0257cac0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:53.986320 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9404ac99-0c73-4db4-873d-e4fa0257cac0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:53.986787 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9404ac99-0c73-4db4-873d-e4fa0257cac0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:53.987499 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9404ac99-0c73-4db4-873d-e4fa0257cac0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:53.987960 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9404ac99-0c73-4db4-873d-e4fa0257cac0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:53.988392 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-9404ac99-0c73-4db4-873d-e4fa0257cac0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:53.992947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:54.127853 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-9404ac99-0c73-4db4-873d-e4fa0257cac0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:54.135574 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-9404ac99-0c73-4db4-873d-e4fa0257cac0 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.163083 Aug 04 22:36:54.136140 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 629/1248] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:53 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:54.280122 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO oslo.messaging._drivers.impl_rabbit [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [0ac3e1e0-11e9-49f1-b167-e34ee4ded995] Reconnected to AMQP server on 10.222.0.109:5672 via [amqp] client with port 37002. Aug 04 22:36:54.284057 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-75cf43b0-221f-4272-a8a5-e12b074a3763 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.724032 Aug 04 22:36:54.284709 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 620/1249] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:36:52 2022] POST /compute/v2.1/servers => generated 408 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:36:54.296606 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-fc5230df-6783-403a-bec8-ce3805b483f3 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:54.297222 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-fc5230df-6783-403a-bec8-ce3805b483f3 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:54.349794 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-fc5230df-6783-403a-bec8-ce3805b483f3 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:54.357056 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-fc5230df-6783-403a-bec8-ce3805b483f3 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1097 microversion: 2.1 time: 0.065450 Aug 04 22:36:54.357641 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 630/1250] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:54 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1097 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:55.157536 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-1633254c-3218-49b1-916f-162a35552bdb tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:55.158170 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-1633254c-3218-49b1-916f-162a35552bdb tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:55.164262 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1633254c-3218-49b1-916f-162a35552bdb tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:55.164749 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1633254c-3218-49b1-916f-162a35552bdb tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:55.165189 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1633254c-3218-49b1-916f-162a35552bdb tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:55.165920 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1633254c-3218-49b1-916f-162a35552bdb tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:55.167140 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1633254c-3218-49b1-916f-162a35552bdb tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:55.167639 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-1633254c-3218-49b1-916f-162a35552bdb tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:55.297268 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-1633254c-3218-49b1-916f-162a35552bdb tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:55.304794 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-1633254c-3218-49b1-916f-162a35552bdb tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1362 microversion: 2.1 time: 0.152004 Aug 04 22:36:55.305290 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 621/1251] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:55 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:55.377116 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-52286a97-d772-491e-943d-e24be81a8434 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:55.377749 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-52286a97-d772-491e-943d-e24be81a8434 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:55.429021 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-52286a97-d772-491e-943d-e24be81a8434 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:55.436199 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-52286a97-d772-491e-943d-e24be81a8434 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1097 microversion: 2.1 time: 0.062839 Aug 04 22:36:55.436754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 631/1252] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:55 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1097 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:56.326862 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-bb2a88ec-ed58-4551-b27e-0354654cc5c2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:56.327478 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-bb2a88ec-ed58-4551-b27e-0354654cc5c2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:56.334272 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bb2a88ec-ed58-4551-b27e-0354654cc5c2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:56.334757 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bb2a88ec-ed58-4551-b27e-0354654cc5c2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:56.335188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bb2a88ec-ed58-4551-b27e-0354654cc5c2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:56.335881 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bb2a88ec-ed58-4551-b27e-0354654cc5c2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:56.336332 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bb2a88ec-ed58-4551-b27e-0354654cc5c2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:56.336754 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-bb2a88ec-ed58-4551-b27e-0354654cc5c2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:56.456162 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-60f37a9f-bc4c-4bda-b79f-8fcee42903c8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:56.458425 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-60f37a9f-bc4c-4bda-b79f-8fcee42903c8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:56.471333 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-bb2a88ec-ed58-4551-b27e-0354654cc5c2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:56.480232 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-bb2a88ec-ed58-4551-b27e-0354654cc5c2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1551 microversion: 2.1 time: 0.158385 Aug 04 22:36:56.481066 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 622/1253] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:56 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:56.501298 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-536f7c16-ee5c-47e4-a720-c7da42ef6c3c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:56.502090 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-536f7c16-ee5c-47e4-a720-c7da42ef6c3c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:56.508185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-536f7c16-ee5c-47e4-a720-c7da42ef6c3c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:56.508665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-536f7c16-ee5c-47e4-a720-c7da42ef6c3c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:56.509094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-536f7c16-ee5c-47e4-a720-c7da42ef6c3c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:56.509823 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-536f7c16-ee5c-47e4-a720-c7da42ef6c3c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:56.510890 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-536f7c16-ee5c-47e4-a720-c7da42ef6c3c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:56.511316 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-536f7c16-ee5c-47e4-a720-c7da42ef6c3c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:56.514494 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-60f37a9f-bc4c-4bda-b79f-8fcee42903c8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:56.521333 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-60f37a9f-bc4c-4bda-b79f-8fcee42903c8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1097 microversion: 2.1 time: 0.069212 Aug 04 22:36:56.521937 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 632/1254] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:56 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1097 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:36:56.646215 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-536f7c16-ee5c-47e4-a720-c7da42ef6c3c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:56.649707 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=100 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:56.654810 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-536f7c16-ee5c-47e4-a720-c7da42ef6c3c tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1551 microversion: 2.1 time: 0.157698 Aug 04 22:36:56.655384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 623/1255] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:56 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:36:56.674116 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-93c67909-8ac3-4f74-9f0d-854674377e12 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:56.678994 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-93c67909-8ac3-4f74-9f0d-854674377e12 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:56.679761 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-93c67909-8ac3-4f74-9f0d-854674377e12 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Searching by: {'deleted': False, 'project_id': '34dc6542be764622b304ee5f895041a2'} {{(pid=129196) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 22:36:56.687695 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-93c67909-8ac3-4f74-9f0d-854674377e12 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:56.688176 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-93c67909-8ac3-4f74-9f0d-854674377e12 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:56.688617 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-93c67909-8ac3-4f74-9f0d-854674377e12 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:56.689347 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-93c67909-8ac3-4f74-9f0d-854674377e12 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:56.689833 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-93c67909-8ac3-4f74-9f0d-854674377e12 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:56.690262 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-93c67909-8ac3-4f74-9f0d-854674377e12 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:56.781277 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.multi_cell_list [None req-93c67909-8ac3-4f74-9f0d-854674377e12 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129196) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 22:36:56.875785 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-93c67909-8ac3-4f74-9f0d-854674377e12 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.205353 Aug 04 22:36:56.876372 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 633/1256] 10.222.0.109 () {58 vars in 1130 bytes} [Thu Aug 4 22:36:56 2022] GET /compute/v2.1/servers => generated 345 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:36:56.887679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-4e1f499b-f902-4458-8237-ab55c4d71713 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:56.888328 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-4e1f499b-f902-4458-8237-ab55c4d71713 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:56.894457 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4e1f499b-f902-4458-8237-ab55c4d71713 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:56.894884 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4e1f499b-f902-4458-8237-ab55c4d71713 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:56.895321 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4e1f499b-f902-4458-8237-ab55c4d71713 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:56.896046 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4e1f499b-f902-4458-8237-ab55c4d71713 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:56.896509 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4e1f499b-f902-4458-8237-ab55c4d71713 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:56.896974 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-4e1f499b-f902-4458-8237-ab55c4d71713 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:57.029538 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-4e1f499b-f902-4458-8237-ab55c4d71713 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:57.036965 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-4e1f499b-f902-4458-8237-ab55c4d71713 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1551 microversion: 2.1 time: 0.153293 Aug 04 22:36:57.037563 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 624/1257] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:56 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:36:57.544264 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-828d00c4-239a-49cb-b0d5-9611f1846593 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:57.544823 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-828d00c4-239a-49cb-b0d5-9611f1846593 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:57.606896 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-828d00c4-239a-49cb-b0d5-9611f1846593 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:57.614553 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-828d00c4-239a-49cb-b0d5-9611f1846593 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1097 microversion: 2.1 time: 0.074326 Aug 04 22:36:57.615127 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 634/1258] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:57 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1097 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:36:58.611437 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-f15ac491-4da1-4d1a-9f9c-952dbb33fba9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da80673c-2736-4b14-afbd-66db75602c91"}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:36:58.613897 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-f15ac491-4da1-4d1a-9f9c-952dbb33fba9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:58.621066 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f15ac491-4da1-4d1a-9f9c-952dbb33fba9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:58.621601 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f15ac491-4da1-4d1a-9f9c-952dbb33fba9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:58.622046 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f15ac491-4da1-4d1a-9f9c-952dbb33fba9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:58.622745 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f15ac491-4da1-4d1a-9f9c-952dbb33fba9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:58.623198 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f15ac491-4da1-4d1a-9f9c-952dbb33fba9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:58.623620 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-f15ac491-4da1-4d1a-9f9c-952dbb33fba9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:58.636282 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1cbf5e9d-9e4a-4b3b-af35-56f9b81ae812 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:58.636898 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1cbf5e9d-9e4a-4b3b-af35-56f9b81ae812 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:58.643924 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1cbf5e9d-9e4a-4b3b-af35-56f9b81ae812 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:58.644447 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1cbf5e9d-9e4a-4b3b-af35-56f9b81ae812 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:58.644948 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1cbf5e9d-9e4a-4b3b-af35-56f9b81ae812 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:58.645626 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1cbf5e9d-9e4a-4b3b-af35-56f9b81ae812 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:58.646088 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1cbf5e9d-9e4a-4b3b-af35-56f9b81ae812 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:58.646519 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1cbf5e9d-9e4a-4b3b-af35-56f9b81ae812 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:58.712115 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1cbf5e9d-9e4a-4b3b-af35-56f9b81ae812 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:58.720108 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1cbf5e9d-9e4a-4b3b-af35-56f9b81ae812 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1147 microversion: 2.1 time: 0.088295 Aug 04 22:36:58.720681 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 635/1259] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:58 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1147 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:36:58.906857 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-f15ac491-4da1-4d1a-9f9c-952dbb33fba9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "POST /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299180 Aug 04 22:36:58.907512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 625/1260] 10.222.0.109 () {60 vars in 1328 bytes} [Thu Aug 4 22:36:58 2022] POST /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:36:59.741344 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-81e461dc-4d38-4a60-8737-6417b5bf0787 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:36:59.744986 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-81e461dc-4d38-4a60-8737-6417b5bf0787 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:36:59.751681 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81e461dc-4d38-4a60-8737-6417b5bf0787 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:59.752188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81e461dc-4d38-4a60-8737-6417b5bf0787 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:59.752617 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81e461dc-4d38-4a60-8737-6417b5bf0787 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:59.753308 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81e461dc-4d38-4a60-8737-6417b5bf0787 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:36:59.753859 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81e461dc-4d38-4a60-8737-6417b5bf0787 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:36:59.754279 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-81e461dc-4d38-4a60-8737-6417b5bf0787 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:36:59.821321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-81e461dc-4d38-4a60-8737-6417b5bf0787 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:36:59.829036 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-81e461dc-4d38-4a60-8737-6417b5bf0787 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1213 microversion: 2.1 time: 0.091706 Aug 04 22:36:59.829653 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 636/1261] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:36:59 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:00.813849 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-7b1086c1-6880-4a66-9e1e-3d8e892e2fee req-1a2e28b4-b950-4545-8145-076a73c98ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e6e910-3014-436c-b435-81eda236a12e", "tag": "c1912177-8d34-41b0-8788-ceb570a14070"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:37:00.824088 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-7b1086c1-6880-4a66-9e1e-3d8e892e2fee req-1a2e28b4-b950-4545-8145-076a73c98ee4 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:00.824865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-7b1086c1-6880-4a66-9e1e-3d8e892e2fee req-1a2e28b4-b950-4545-8145-076a73c98ee4 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:00.825305 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-7b1086c1-6880-4a66-9e1e-3d8e892e2fee req-1a2e28b4-b950-4545-8145-076a73c98ee4 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:00.836550 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-7b1086c1-6880-4a66-9e1e-3d8e892e2fee req-1a2e28b4-b950-4545-8145-076a73c98ee4 service nova] Creating event network-changed:c1912177-8d34-41b0-8788-ceb570a14070 for instance d3e6e910-3014-436c-b435-81eda236a12e on hv-cinder-85221 Aug 04 22:37:00.842165 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-7b1086c1-6880-4a66-9e1e-3d8e892e2fee req-1a2e28b4-b950-4545-8145-076a73c98ee4 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101168 Aug 04 22:37:00.842763 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 626/1262] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:37:00.850225 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-73ee28fe-4cd6-4d36-8f10-fc8ce42d9bfd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:00.850863 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-73ee28fe-4cd6-4d36-8f10-fc8ce42d9bfd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:00.857367 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73ee28fe-4cd6-4d36-8f10-fc8ce42d9bfd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:00.857880 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73ee28fe-4cd6-4d36-8f10-fc8ce42d9bfd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:00.858346 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73ee28fe-4cd6-4d36-8f10-fc8ce42d9bfd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:00.859062 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73ee28fe-4cd6-4d36-8f10-fc8ce42d9bfd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:00.859493 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73ee28fe-4cd6-4d36-8f10-fc8ce42d9bfd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:00.859916 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-73ee28fe-4cd6-4d36-8f10-fc8ce42d9bfd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:00.992255 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-73ee28fe-4cd6-4d36-8f10-fc8ce42d9bfd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:01.000758 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-73ee28fe-4cd6-4d36-8f10-fc8ce42d9bfd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1281 microversion: 2.1 time: 0.154520 Aug 04 22:37:01.001464 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 637/1263] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:00 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:02.022596 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0f81bf8c-1f57-48b2-a885-4e3bbb3dd0b4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:02.023309 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0f81bf8c-1f57-48b2-a885-4e3bbb3dd0b4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:02.029576 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f81bf8c-1f57-48b2-a885-4e3bbb3dd0b4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:02.030075 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f81bf8c-1f57-48b2-a885-4e3bbb3dd0b4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:02.030520 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f81bf8c-1f57-48b2-a885-4e3bbb3dd0b4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:02.031223 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f81bf8c-1f57-48b2-a885-4e3bbb3dd0b4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:02.031684 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f81bf8c-1f57-48b2-a885-4e3bbb3dd0b4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:02.032113 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0f81bf8c-1f57-48b2-a885-4e3bbb3dd0b4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:02.172606 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0f81bf8c-1f57-48b2-a885-4e3bbb3dd0b4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:02.180034 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0f81bf8c-1f57-48b2-a885-4e3bbb3dd0b4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1281 microversion: 2.1 time: 0.162149 Aug 04 22:37:02.180602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 627/1264] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:02 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1281 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:03.201166 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-90e8fa58-9f75-4a29-b749-2df5ab1964f8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:03.201814 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-90e8fa58-9f75-4a29-b749-2df5ab1964f8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:03.208777 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-90e8fa58-9f75-4a29-b749-2df5ab1964f8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:03.209223 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-90e8fa58-9f75-4a29-b749-2df5ab1964f8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:03.209705 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-90e8fa58-9f75-4a29-b749-2df5ab1964f8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:03.210407 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-90e8fa58-9f75-4a29-b749-2df5ab1964f8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:03.210863 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-90e8fa58-9f75-4a29-b749-2df5ab1964f8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:03.211321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-90e8fa58-9f75-4a29-b749-2df5ab1964f8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:03.344579 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-90e8fa58-9f75-4a29-b749-2df5ab1964f8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:03.351911 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-90e8fa58-9f75-4a29-b749-2df5ab1964f8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1281 microversion: 2.1 time: 0.155848 Aug 04 22:37:03.352480 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 638/1265] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:03 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:04.374084 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e293b7b8-2215-4812-9d1b-8843ffbbdb59 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:04.374663 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e293b7b8-2215-4812-9d1b-8843ffbbdb59 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:04.377051 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:04.377865 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=6 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:04.378598 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:04.385089 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e293b7b8-2215-4812-9d1b-8843ffbbdb59 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:04.385614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e293b7b8-2215-4812-9d1b-8843ffbbdb59 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:04.386059 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e293b7b8-2215-4812-9d1b-8843ffbbdb59 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:04.386759 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e293b7b8-2215-4812-9d1b-8843ffbbdb59 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:04.387216 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e293b7b8-2215-4812-9d1b-8843ffbbdb59 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:04.387645 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e293b7b8-2215-4812-9d1b-8843ffbbdb59 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:04.518310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e293b7b8-2215-4812-9d1b-8843ffbbdb59 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:04.526748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e293b7b8-2215-4812-9d1b-8843ffbbdb59 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1281 microversion: 2.1 time: 0.156729 Aug 04 22:37:04.527318 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 628/1266] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:04 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1281 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:05.547315 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-acf90c5d-8b3d-4d44-8962-27c7ec57df34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:05.547883 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-acf90c5d-8b3d-4d44-8962-27c7ec57df34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:05.550242 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:05.555243 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-acf90c5d-8b3d-4d44-8962-27c7ec57df34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:05.555726 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-acf90c5d-8b3d-4d44-8962-27c7ec57df34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:05.556714 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-acf90c5d-8b3d-4d44-8962-27c7ec57df34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:05.557594 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-acf90c5d-8b3d-4d44-8962-27c7ec57df34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:05.558053 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-acf90c5d-8b3d-4d44-8962-27c7ec57df34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:05.558480 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-acf90c5d-8b3d-4d44-8962-27c7ec57df34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:05.691491 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-acf90c5d-8b3d-4d44-8962-27c7ec57df34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:05.700164 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-acf90c5d-8b3d-4d44-8962-27c7ec57df34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1281 microversion: 2.1 time: 0.156759 Aug 04 22:37:05.700759 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 639/1267] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:05 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:06.494628 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-eee0d91b-2944-4401-ac2d-34c1811d8c5f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:06.495238 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-eee0d91b-2944-4401-ac2d-34c1811d8c5f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:06.502193 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eee0d91b-2944-4401-ac2d-34c1811d8c5f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:06.502684 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eee0d91b-2944-4401-ac2d-34c1811d8c5f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:06.503125 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eee0d91b-2944-4401-ac2d-34c1811d8c5f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:06.503831 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eee0d91b-2944-4401-ac2d-34c1811d8c5f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:06.504288 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eee0d91b-2944-4401-ac2d-34c1811d8c5f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:06.504720 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-eee0d91b-2944-4401-ac2d-34c1811d8c5f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:06.647320 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-eee0d91b-2944-4401-ac2d-34c1811d8c5f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:06.655989 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-eee0d91b-2944-4401-ac2d-34c1811d8c5f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1597 microversion: 2.1 time: 0.165496 Aug 04 22:37:06.656558 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 629/1268] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:06 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1597 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:06.721018 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-55732e85-d4f3-4c98-a840-9694aefa6e3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:06.722448 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-55732e85-d4f3-4c98-a840-9694aefa6e3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:06.723947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:06.729602 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55732e85-d4f3-4c98-a840-9694aefa6e3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:06.730342 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55732e85-d4f3-4c98-a840-9694aefa6e3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:06.731006 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55732e85-d4f3-4c98-a840-9694aefa6e3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:06.731968 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55732e85-d4f3-4c98-a840-9694aefa6e3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:06.732497 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55732e85-d4f3-4c98-a840-9694aefa6e3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:06.733160 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-55732e85-d4f3-4c98-a840-9694aefa6e3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:06.950769 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-55732e85-d4f3-4c98-a840-9694aefa6e3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:06.958653 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-55732e85-d4f3-4c98-a840-9694aefa6e3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1269 microversion: 2.1 time: 0.241339 Aug 04 22:37:06.959223 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 640/1269] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:06 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1269 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:07.981017 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-74eee445-618e-48b6-8a92-dc75e0878198 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:07.981679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-74eee445-618e-48b6-8a92-dc75e0878198 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:07.987754 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-74eee445-618e-48b6-8a92-dc75e0878198 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:07.988236 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-74eee445-618e-48b6-8a92-dc75e0878198 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:07.988670 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-74eee445-618e-48b6-8a92-dc75e0878198 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:07.989361 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-74eee445-618e-48b6-8a92-dc75e0878198 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:07.989848 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-74eee445-618e-48b6-8a92-dc75e0878198 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:07.990273 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-74eee445-618e-48b6-8a92-dc75e0878198 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:08.125862 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-74eee445-618e-48b6-8a92-dc75e0878198 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:08.133336 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-74eee445-618e-48b6-8a92-dc75e0878198 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1269 microversion: 2.1 time: 0.157023 Aug 04 22:37:08.134589 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 630/1270] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:07 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:08.374483 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-fc1105d7-f66f-4c8d-8550-a7ad726ed1ea req-842bf39e-c87d-4f6c-832a-a9b4dbc52d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e046be-ac38-431d-94a6-cc0857be49cc", "tag": "f0e67f32-c3b1-4fa5-85b0-9006d13726ee"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:37:08.382462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=8 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:08.386099 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-fc1105d7-f66f-4c8d-8550-a7ad726ed1ea req-842bf39e-c87d-4f6c-832a-a9b4dbc52d62 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:08.386572 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-fc1105d7-f66f-4c8d-8550-a7ad726ed1ea req-842bf39e-c87d-4f6c-832a-a9b4dbc52d62 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:08.387247 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-fc1105d7-f66f-4c8d-8550-a7ad726ed1ea req-842bf39e-c87d-4f6c-832a-a9b4dbc52d62 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:08.399946 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-fc1105d7-f66f-4c8d-8550-a7ad726ed1ea req-842bf39e-c87d-4f6c-832a-a9b4dbc52d62 service nova] Creating event network-changed:f0e67f32-c3b1-4fa5-85b0-9006d13726ee for instance d3e046be-ac38-431d-94a6-cc0857be49cc on hv-cinder-85221 Aug 04 22:37:08.405022 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-fc1105d7-f66f-4c8d-8550-a7ad726ed1ea req-842bf39e-c87d-4f6c-832a-a9b4dbc52d62 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034269 Aug 04 22:37:08.405665 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 641/1271] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:37:09.155012 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-7e746aeb-fa6c-4a84-831b-c4b2fb1aea75 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:09.155758 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-7e746aeb-fa6c-4a84-831b-c4b2fb1aea75 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:09.162032 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e746aeb-fa6c-4a84-831b-c4b2fb1aea75 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:09.162518 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e746aeb-fa6c-4a84-831b-c4b2fb1aea75 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:09.162950 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e746aeb-fa6c-4a84-831b-c4b2fb1aea75 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:09.163649 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e746aeb-fa6c-4a84-831b-c4b2fb1aea75 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:09.164109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e746aeb-fa6c-4a84-831b-c4b2fb1aea75 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:09.164528 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-7e746aeb-fa6c-4a84-831b-c4b2fb1aea75 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:09.314856 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-7e746aeb-fa6c-4a84-831b-c4b2fb1aea75 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:09.323046 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-7e746aeb-fa6c-4a84-831b-c4b2fb1aea75 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1269 microversion: 2.1 time: 0.171939 Aug 04 22:37:09.323700 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 631/1272] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:09 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:09.409096 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-342ded61-cfe1-4bcb-b493-488ac4abe916 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1475398053"}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:37:09.409763 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-342ded61-cfe1-4bcb-b493-488ac4abe916 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:09.416732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-342ded61-cfe1-4bcb-b493-488ac4abe916 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:09.417224 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-342ded61-cfe1-4bcb-b493-488ac4abe916 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:09.417692 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-342ded61-cfe1-4bcb-b493-488ac4abe916 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:09.418399 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-342ded61-cfe1-4bcb-b493-488ac4abe916 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:09.418881 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-342ded61-cfe1-4bcb-b493-488ac4abe916 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:09.419282 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-342ded61-cfe1-4bcb-b493-488ac4abe916 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:09.552540 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.network.security_group_api [None req-342ded61-cfe1-4bcb-b493-488ac4abe916 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Adding security group 9f1b2279-1b6a-4584-9762-a4c95ff2dd45 to port f0e67f32-c3b1-4fa5-85b0-9006d13726ee Aug 04 22:37:09.870986 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-342ded61-cfe1-4bcb-b493-488ac4abe916 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "POST /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/action" status: 202 len: 0 microversion: 2.1 time: 0.466621 Aug 04 22:37:09.871683 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 642/1273] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:37:09 2022] POST /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:37:09.879919 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-26ac9225-3dda-4983-9525-ff6b0dd7c7d4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:09.880539 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-26ac9225-3dda-4983-9525-ff6b0dd7c7d4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:09.887357 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26ac9225-3dda-4983-9525-ff6b0dd7c7d4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:09.887849 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26ac9225-3dda-4983-9525-ff6b0dd7c7d4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:09.888287 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26ac9225-3dda-4983-9525-ff6b0dd7c7d4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:09.889189 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26ac9225-3dda-4983-9525-ff6b0dd7c7d4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:09.889713 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26ac9225-3dda-4983-9525-ff6b0dd7c7d4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:09.890143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-26ac9225-3dda-4983-9525-ff6b0dd7c7d4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:10.039728 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-26ac9225-3dda-4983-9525-ff6b0dd7c7d4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:10.048447 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-26ac9225-3dda-4983-9525-ff6b0dd7c7d4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1762 microversion: 2.1 time: 0.172468 Aug 04 22:37:10.049057 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 632/1274] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:09 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1762 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:37:10.343618 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8f208d94-bea3-461f-8526-3870106811d9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:10.344328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8f208d94-bea3-461f-8526-3870106811d9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:10.350712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f208d94-bea3-461f-8526-3870106811d9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:10.351194 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f208d94-bea3-461f-8526-3870106811d9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:10.351632 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f208d94-bea3-461f-8526-3870106811d9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:10.352327 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f208d94-bea3-461f-8526-3870106811d9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:10.352784 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f208d94-bea3-461f-8526-3870106811d9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:10.353215 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8f208d94-bea3-461f-8526-3870106811d9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:10.426191 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-bd0c5bec-2ef5-413d-ac99-b47c8a654e5d req-501aa2fc-4c39-4b6a-9474-c28c1d7f2a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e046be-ac38-431d-94a6-cc0857be49cc", "tag": "f0e67f32-c3b1-4fa5-85b0-9006d13726ee"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:37:10.436493 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-bd0c5bec-2ef5-413d-ac99-b47c8a654e5d req-501aa2fc-4c39-4b6a-9474-c28c1d7f2a3a service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:10.437128 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-bd0c5bec-2ef5-413d-ac99-b47c8a654e5d req-501aa2fc-4c39-4b6a-9474-c28c1d7f2a3a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:10.437717 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-bd0c5bec-2ef5-413d-ac99-b47c8a654e5d req-501aa2fc-4c39-4b6a-9474-c28c1d7f2a3a service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:10.450648 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-bd0c5bec-2ef5-413d-ac99-b47c8a654e5d req-501aa2fc-4c39-4b6a-9474-c28c1d7f2a3a service nova] Creating event network-changed:f0e67f32-c3b1-4fa5-85b0-9006d13726ee for instance d3e046be-ac38-431d-94a6-cc0857be49cc on hv-cinder-85221 Aug 04 22:37:10.456168 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-bd0c5bec-2ef5-413d-ac99-b47c8a654e5d req-501aa2fc-4c39-4b6a-9474-c28c1d7f2a3a service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033644 Aug 04 22:37:10.457157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 633/1275] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:37:10.503377 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8f208d94-bea3-461f-8526-3870106811d9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:10.511782 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8f208d94-bea3-461f-8526-3870106811d9 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1269 microversion: 2.1 time: 0.172064 Aug 04 22:37:10.512357 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 643/1276] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:10 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:11.535307 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9220ce48-e839-48c3-bf4a-48c0147e15f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:11.536001 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-9220ce48-e839-48c3-bf4a-48c0147e15f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:11.542916 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9220ce48-e839-48c3-bf4a-48c0147e15f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:11.543393 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9220ce48-e839-48c3-bf4a-48c0147e15f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:11.543824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9220ce48-e839-48c3-bf4a-48c0147e15f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:11.544510 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9220ce48-e839-48c3-bf4a-48c0147e15f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:11.544958 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9220ce48-e839-48c3-bf4a-48c0147e15f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:11.545377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-9220ce48-e839-48c3-bf4a-48c0147e15f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:11.678630 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-9220ce48-e839-48c3-bf4a-48c0147e15f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:11.686463 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9220ce48-e839-48c3-bf4a-48c0147e15f7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1269 microversion: 2.1 time: 0.157653 Aug 04 22:37:11.687032 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 634/1277] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:11 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:12.707944 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a30e13c0-9af3-46cb-81b2-3c7d7e9b96b8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:12.708559 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a30e13c0-9af3-46cb-81b2-3c7d7e9b96b8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:12.715493 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a30e13c0-9af3-46cb-81b2-3c7d7e9b96b8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:12.715965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a30e13c0-9af3-46cb-81b2-3c7d7e9b96b8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:12.716393 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a30e13c0-9af3-46cb-81b2-3c7d7e9b96b8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:12.717072 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a30e13c0-9af3-46cb-81b2-3c7d7e9b96b8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:12.717541 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a30e13c0-9af3-46cb-81b2-3c7d7e9b96b8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:12.717960 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-a30e13c0-9af3-46cb-81b2-3c7d7e9b96b8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:12.847281 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a30e13c0-9af3-46cb-81b2-3c7d7e9b96b8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:12.854859 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a30e13c0-9af3-46cb-81b2-3c7d7e9b96b8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1269 microversion: 2.1 time: 0.150721 Aug 04 22:37:12.855411 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 644/1278] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:12 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:13.874379 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-51df7a58-a48e-4d19-bdb2-cc87aca8f996 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:13.875017 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-51df7a58-a48e-4d19-bdb2-cc87aca8f996 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:13.881536 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-51df7a58-a48e-4d19-bdb2-cc87aca8f996 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:13.882162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-51df7a58-a48e-4d19-bdb2-cc87aca8f996 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:13.882592 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-51df7a58-a48e-4d19-bdb2-cc87aca8f996 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:13.883279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-51df7a58-a48e-4d19-bdb2-cc87aca8f996 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:13.883750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-51df7a58-a48e-4d19-bdb2-cc87aca8f996 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:13.884318 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-51df7a58-a48e-4d19-bdb2-cc87aca8f996 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:14.022463 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-51df7a58-a48e-4d19-bdb2-cc87aca8f996 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:14.031087 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-51df7a58-a48e-4d19-bdb2-cc87aca8f996 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1269 microversion: 2.1 time: 0.160610 Aug 04 22:37:14.031644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 635/1279] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:13 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:15.051452 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c77c3369-826c-4b29-8ec2-ee9ccac8e5fb tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:15.052067 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c77c3369-826c-4b29-8ec2-ee9ccac8e5fb tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:15.058679 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c77c3369-826c-4b29-8ec2-ee9ccac8e5fb tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:15.059160 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c77c3369-826c-4b29-8ec2-ee9ccac8e5fb tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:15.059593 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c77c3369-826c-4b29-8ec2-ee9ccac8e5fb tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:15.060292 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c77c3369-826c-4b29-8ec2-ee9ccac8e5fb tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:15.060743 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c77c3369-826c-4b29-8ec2-ee9ccac8e5fb tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:15.061200 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c77c3369-826c-4b29-8ec2-ee9ccac8e5fb tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:15.190285 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c77c3369-826c-4b29-8ec2-ee9ccac8e5fb tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:15.198311 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c77c3369-826c-4b29-8ec2-ee9ccac8e5fb tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1269 microversion: 2.1 time: 0.150687 Aug 04 22:37:15.198873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 645/1280] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:15 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:16.219376 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-88165962-d73c-4f62-8d65-c691b4b3c993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:16.220003 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-88165962-d73c-4f62-8d65-c691b4b3c993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:16.226515 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88165962-d73c-4f62-8d65-c691b4b3c993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:16.227004 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88165962-d73c-4f62-8d65-c691b4b3c993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:16.227512 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88165962-d73c-4f62-8d65-c691b4b3c993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:16.228189 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88165962-d73c-4f62-8d65-c691b4b3c993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:16.228651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88165962-d73c-4f62-8d65-c691b4b3c993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:16.229079 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-88165962-d73c-4f62-8d65-c691b4b3c993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:16.365025 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-88165962-d73c-4f62-8d65-c691b4b3c993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:16.372948 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-88165962-d73c-4f62-8d65-c691b4b3c993 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1269 microversion: 2.1 time: 0.157508 Aug 04 22:37:16.373679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 636/1281] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:16 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:17.394409 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-1b9e0878-0545-4ce6-9dda-978f3f4c6ea2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:17.395012 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-1b9e0878-0545-4ce6-9dda-978f3f4c6ea2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:17.401604 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b9e0878-0545-4ce6-9dda-978f3f4c6ea2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:17.402089 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b9e0878-0545-4ce6-9dda-978f3f4c6ea2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:17.402526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b9e0878-0545-4ce6-9dda-978f3f4c6ea2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:17.403219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b9e0878-0545-4ce6-9dda-978f3f4c6ea2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:17.403670 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b9e0878-0545-4ce6-9dda-978f3f4c6ea2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:17.404092 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-1b9e0878-0545-4ce6-9dda-978f3f4c6ea2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:17.534757 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-1b9e0878-0545-4ce6-9dda-978f3f4c6ea2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:17.542435 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-1b9e0878-0545-4ce6-9dda-978f3f4c6ea2 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1269 microversion: 2.1 time: 0.151905 Aug 04 22:37:17.543010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 646/1282] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:17 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:17.751810 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-c0b421cb-60e6-483c-8f18-8e8319fa3adb req-669a1110-b79f-4be1-a3b3-2f7cccf901b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e6e910-3014-436c-b435-81eda236a12e", "name": "network-vif-plugged", "status": "completed", "tag": "c1912177-8d34-41b0-8788-ceb570a14070"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:37:17.762712 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c0b421cb-60e6-483c-8f18-8e8319fa3adb req-669a1110-b79f-4be1-a3b3-2f7cccf901b0 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:17.763214 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c0b421cb-60e6-483c-8f18-8e8319fa3adb req-669a1110-b79f-4be1-a3b3-2f7cccf901b0 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:17.763640 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-c0b421cb-60e6-483c-8f18-8e8319fa3adb req-669a1110-b79f-4be1-a3b3-2f7cccf901b0 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:17.775462 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-c0b421cb-60e6-483c-8f18-8e8319fa3adb req-669a1110-b79f-4be1-a3b3-2f7cccf901b0 service nova] Creating event network-vif-plugged:c1912177-8d34-41b0-8788-ceb570a14070 for instance d3e6e910-3014-436c-b435-81eda236a12e on hv-cinder-85221 Aug 04 22:37:17.780289 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-c0b421cb-60e6-483c-8f18-8e8319fa3adb req-669a1110-b79f-4be1-a3b3-2f7cccf901b0 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032240 Aug 04 22:37:17.780963 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 637/1283] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:37:18.564177 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5e044c9f-3da8-4a60-ae17-389f0ac97718 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:18.564792 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5e044c9f-3da8-4a60-ae17-389f0ac97718 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:18.571430 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5e044c9f-3da8-4a60-ae17-389f0ac97718 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:18.571916 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5e044c9f-3da8-4a60-ae17-389f0ac97718 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:18.572355 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5e044c9f-3da8-4a60-ae17-389f0ac97718 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:18.573052 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5e044c9f-3da8-4a60-ae17-389f0ac97718 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:18.573535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5e044c9f-3da8-4a60-ae17-389f0ac97718 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:18.573967 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5e044c9f-3da8-4a60-ae17-389f0ac97718 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:18.707523 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5e044c9f-3da8-4a60-ae17-389f0ac97718 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:18.715109 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5e044c9f-3da8-4a60-ae17-389f0ac97718 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1269 microversion: 2.1 time: 0.154757 Aug 04 22:37:18.715677 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 647/1284] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:18 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:19.737492 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0a833f98-9983-47f8-a02b-7dcf0de4f8af tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:19.738225 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0a833f98-9983-47f8-a02b-7dcf0de4f8af tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:19.744922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a833f98-9983-47f8-a02b-7dcf0de4f8af tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:19.745440 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a833f98-9983-47f8-a02b-7dcf0de4f8af tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:19.745878 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a833f98-9983-47f8-a02b-7dcf0de4f8af tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:19.746579 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a833f98-9983-47f8-a02b-7dcf0de4f8af tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:19.747039 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a833f98-9983-47f8-a02b-7dcf0de4f8af tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:19.747467 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a833f98-9983-47f8-a02b-7dcf0de4f8af tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:19.888615 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0a833f98-9983-47f8-a02b-7dcf0de4f8af tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:19.896799 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0a833f98-9983-47f8-a02b-7dcf0de4f8af tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1269 microversion: 2.1 time: 0.164092 Aug 04 22:37:19.897458 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 638/1285] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:19 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:20.920347 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-eb3358e9-cf38-421d-96f2-6d8b48809f7a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:20.920964 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-eb3358e9-cf38-421d-96f2-6d8b48809f7a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:20.927432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eb3358e9-cf38-421d-96f2-6d8b48809f7a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:20.927914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eb3358e9-cf38-421d-96f2-6d8b48809f7a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:20.928350 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eb3358e9-cf38-421d-96f2-6d8b48809f7a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:20.929044 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eb3358e9-cf38-421d-96f2-6d8b48809f7a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:20.929526 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eb3358e9-cf38-421d-96f2-6d8b48809f7a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:20.930129 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-eb3358e9-cf38-421d-96f2-6d8b48809f7a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:21.067787 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-eb3358e9-cf38-421d-96f2-6d8b48809f7a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:21.076213 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-eb3358e9-cf38-421d-96f2-6d8b48809f7a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1455 microversion: 2.1 time: 0.159693 Aug 04 22:37:21.076794 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 648/1286] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:20 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:21.097287 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-efc14264-81f6-483c-91a7-0378b8e64a5d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:37:21.097934 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-efc14264-81f6-483c-91a7-0378b8e64a5d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:37:21.105010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-efc14264-81f6-483c-91a7-0378b8e64a5d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:21.105557 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-efc14264-81f6-483c-91a7-0378b8e64a5d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:21.106003 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-efc14264-81f6-483c-91a7-0378b8e64a5d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:21.106709 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-efc14264-81f6-483c-91a7-0378b8e64a5d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:21.107167 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-efc14264-81f6-483c-91a7-0378b8e64a5d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:21.107594 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-efc14264-81f6-483c-91a7-0378b8e64a5d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:21.238836 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-efc14264-81f6-483c-91a7-0378b8e64a5d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:37:21.247146 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-efc14264-81f6-483c-91a7-0378b8e64a5d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1455 microversion: 2.1 time: 0.153699 Aug 04 22:37:21.247713 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 639/1287] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:37:21 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:37:22.811631 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-8653de10-6f00-45c9-8a1b-7db812185025 req-30959195-6d03-4661-9e83-259836b0f60d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e6e910-3014-436c-b435-81eda236a12e", "tag": "c1912177-8d34-41b0-8788-ceb570a14070"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:37:22.822293 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-8653de10-6f00-45c9-8a1b-7db812185025 req-30959195-6d03-4661-9e83-259836b0f60d service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:37:22.822772 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-8653de10-6f00-45c9-8a1b-7db812185025 req-30959195-6d03-4661-9e83-259836b0f60d service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:37:22.823197 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-8653de10-6f00-45c9-8a1b-7db812185025 req-30959195-6d03-4661-9e83-259836b0f60d service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:37:22.834169 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-8653de10-6f00-45c9-8a1b-7db812185025 req-30959195-6d03-4661-9e83-259836b0f60d service nova] Creating event network-changed:c1912177-8d34-41b0-8788-ceb570a14070 for instance d3e6e910-3014-436c-b435-81eda236a12e on hv-cinder-85221 Aug 04 22:37:22.839334 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-8653de10-6f00-45c9-8a1b-7db812185025 req-30959195-6d03-4661-9e83-259836b0f60d service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031494 Aug 04 22:37:22.839905 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 649/1288] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:38:10.578525 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-283dbb17-a87a-4a9a-889f-27aa743eccb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:38:10.580730 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-283dbb17-a87a-4a9a-889f-27aa743eccb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:38:10.583524 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=23 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:10.584188 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:10.590466 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-283dbb17-a87a-4a9a-889f-27aa743eccb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:10.598367 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-283dbb17-a87a-4a9a-889f-27aa743eccb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:10.598820 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-283dbb17-a87a-4a9a-889f-27aa743eccb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:10.599551 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-283dbb17-a87a-4a9a-889f-27aa743eccb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:10.600020 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-283dbb17-a87a-4a9a-889f-27aa743eccb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:10.600461 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-283dbb17-a87a-4a9a-889f-27aa743eccb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:10.673794 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-283dbb17-a87a-4a9a-889f-27aa743eccb8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "POST /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/action" status: 202 len: 0 microversion: 2.1 time: 0.099516 Aug 04 22:38:10.674435 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 640/1289] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:38:10 2022] POST /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:38:10.683745 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8c3122f8-e65c-4eac-838e-9abdc60edc20 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:38:10.684472 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8c3122f8-e65c-4eac-838e-9abdc60edc20 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:38:10.686646 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=21 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:10.687281 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=92 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:10.695890 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8c3122f8-e65c-4eac-838e-9abdc60edc20 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:10.696422 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8c3122f8-e65c-4eac-838e-9abdc60edc20 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:10.696861 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8c3122f8-e65c-4eac-838e-9abdc60edc20 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:10.697626 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8c3122f8-e65c-4eac-838e-9abdc60edc20 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:10.698112 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8c3122f8-e65c-4eac-838e-9abdc60edc20 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:10.698540 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8c3122f8-e65c-4eac-838e-9abdc60edc20 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:10.850172 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8c3122f8-e65c-4eac-838e-9abdc60edc20 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:38:10.858177 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8c3122f8-e65c-4eac-838e-9abdc60edc20 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1754 microversion: 2.1 time: 0.178797 Aug 04 22:38:10.858741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 650/1290] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:38:10 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:38:11.880873 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-cd5b2c76-b72f-4e95-a19c-32608d42a1f9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:38:11.881716 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-cd5b2c76-b72f-4e95-a19c-32608d42a1f9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:38:11.887868 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cd5b2c76-b72f-4e95-a19c-32608d42a1f9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:11.888344 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cd5b2c76-b72f-4e95-a19c-32608d42a1f9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:11.888774 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cd5b2c76-b72f-4e95-a19c-32608d42a1f9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:11.889488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cd5b2c76-b72f-4e95-a19c-32608d42a1f9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:11.889937 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cd5b2c76-b72f-4e95-a19c-32608d42a1f9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:11.890356 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-cd5b2c76-b72f-4e95-a19c-32608d42a1f9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:12.041613 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-cd5b2c76-b72f-4e95-a19c-32608d42a1f9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:38:12.049896 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-cd5b2c76-b72f-4e95-a19c-32608d42a1f9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1759 microversion: 2.1 time: 0.173844 Aug 04 22:38:12.050462 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 641/1291] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:38:11 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:38:13.072648 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6b319692-7902-452b-b151-24fbd4ba4cf8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:38:13.073246 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6b319692-7902-452b-b151-24fbd4ba4cf8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:38:13.080017 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b319692-7902-452b-b151-24fbd4ba4cf8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:13.080518 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b319692-7902-452b-b151-24fbd4ba4cf8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:13.080955 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b319692-7902-452b-b151-24fbd4ba4cf8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:13.081673 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b319692-7902-452b-b151-24fbd4ba4cf8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:13.082574 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b319692-7902-452b-b151-24fbd4ba4cf8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:13.083020 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6b319692-7902-452b-b151-24fbd4ba4cf8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:13.224667 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6b319692-7902-452b-b151-24fbd4ba4cf8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:38:13.232586 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6b319692-7902-452b-b151-24fbd4ba4cf8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1759 microversion: 2.1 time: 0.163846 Aug 04 22:38:13.233151 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 651/1292] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:38:13 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:38:14.255903 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ca439de8-d46e-406d-a651-48594568075b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:38:14.256555 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ca439de8-d46e-406d-a651-48594568075b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:38:14.262811 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ca439de8-d46e-406d-a651-48594568075b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:14.263286 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ca439de8-d46e-406d-a651-48594568075b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:14.263714 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ca439de8-d46e-406d-a651-48594568075b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:14.264398 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ca439de8-d46e-406d-a651-48594568075b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:14.264843 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ca439de8-d46e-406d-a651-48594568075b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:14.265257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ca439de8-d46e-406d-a651-48594568075b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:14.404890 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ca439de8-d46e-406d-a651-48594568075b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:38:14.413573 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ca439de8-d46e-406d-a651-48594568075b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1759 microversion: 2.1 time: 0.162365 Aug 04 22:38:14.414161 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 642/1293] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:38:14 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:38:15.434161 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-555aa414-5ec7-496a-bc36-551f253496b2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:38:15.434838 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-555aa414-5ec7-496a-bc36-551f253496b2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:38:15.441732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-555aa414-5ec7-496a-bc36-551f253496b2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:15.442315 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-555aa414-5ec7-496a-bc36-551f253496b2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:15.442747 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-555aa414-5ec7-496a-bc36-551f253496b2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:15.443438 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-555aa414-5ec7-496a-bc36-551f253496b2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:15.443893 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-555aa414-5ec7-496a-bc36-551f253496b2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:15.444321 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-555aa414-5ec7-496a-bc36-551f253496b2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:15.589980 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-555aa414-5ec7-496a-bc36-551f253496b2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:38:15.597989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-555aa414-5ec7-496a-bc36-551f253496b2 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1759 microversion: 2.1 time: 0.167621 Aug 04 22:38:15.598557 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 652/1294] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:38:15 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:38:16.619497 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-999efdcc-83f1-410f-a06c-aeed8621354f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:38:16.620147 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-999efdcc-83f1-410f-a06c-aeed8621354f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:38:16.626823 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-999efdcc-83f1-410f-a06c-aeed8621354f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:16.627315 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-999efdcc-83f1-410f-a06c-aeed8621354f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:16.627754 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-999efdcc-83f1-410f-a06c-aeed8621354f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:16.628494 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-999efdcc-83f1-410f-a06c-aeed8621354f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:16.628970 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-999efdcc-83f1-410f-a06c-aeed8621354f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:16.629401 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-999efdcc-83f1-410f-a06c-aeed8621354f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:16.778660 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-999efdcc-83f1-410f-a06c-aeed8621354f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:38:16.787176 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-999efdcc-83f1-410f-a06c-aeed8621354f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1759 microversion: 2.1 time: 0.172032 Aug 04 22:38:16.787749 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 643/1295] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:38:16 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:38:17.808155 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-b853b7a6-879d-492a-bb48-02a4b1429d46 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:38:17.808720 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-b853b7a6-879d-492a-bb48-02a4b1429d46 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:38:17.814998 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b853b7a6-879d-492a-bb48-02a4b1429d46 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:17.815468 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b853b7a6-879d-492a-bb48-02a4b1429d46 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:17.815965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b853b7a6-879d-492a-bb48-02a4b1429d46 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:17.816949 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b853b7a6-879d-492a-bb48-02a4b1429d46 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:17.817396 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b853b7a6-879d-492a-bb48-02a4b1429d46 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:17.817839 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-b853b7a6-879d-492a-bb48-02a4b1429d46 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:17.959188 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-b853b7a6-879d-492a-bb48-02a4b1429d46 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:38:17.967098 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-b853b7a6-879d-492a-bb48-02a4b1429d46 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1759 microversion: 2.1 time: 0.162910 Aug 04 22:38:17.967666 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 653/1296] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:38:17 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:38:18.989927 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-304faca1-7723-49cf-bc57-43094289e7c1 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:38:18.990568 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-304faca1-7723-49cf-bc57-43094289e7c1 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:38:18.996780 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-304faca1-7723-49cf-bc57-43094289e7c1 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:18.997293 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-304faca1-7723-49cf-bc57-43094289e7c1 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:18.997758 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-304faca1-7723-49cf-bc57-43094289e7c1 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:18.998443 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-304faca1-7723-49cf-bc57-43094289e7c1 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:18.998899 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-304faca1-7723-49cf-bc57-43094289e7c1 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:18.999318 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-304faca1-7723-49cf-bc57-43094289e7c1 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:19.145165 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-304faca1-7723-49cf-bc57-43094289e7c1 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:38:19.153609 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-304faca1-7723-49cf-bc57-43094289e7c1 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1759 microversion: 2.1 time: 0.168133 Aug 04 22:38:19.154182 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 644/1297] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:38:18 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:38:20.174692 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-8e6f6edd-2a1a-4809-ad9e-3257c6e31b09 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:38:20.175400 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-8e6f6edd-2a1a-4809-ad9e-3257c6e31b09 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:38:20.181717 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8e6f6edd-2a1a-4809-ad9e-3257c6e31b09 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:20.182190 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8e6f6edd-2a1a-4809-ad9e-3257c6e31b09 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:20.182614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8e6f6edd-2a1a-4809-ad9e-3257c6e31b09 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:20.183292 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8e6f6edd-2a1a-4809-ad9e-3257c6e31b09 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:20.183734 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8e6f6edd-2a1a-4809-ad9e-3257c6e31b09 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:20.184150 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-8e6f6edd-2a1a-4809-ad9e-3257c6e31b09 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:20.327875 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-8e6f6edd-2a1a-4809-ad9e-3257c6e31b09 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:38:20.336732 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-8e6f6edd-2a1a-4809-ad9e-3257c6e31b09 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1759 microversion: 2.1 time: 0.165839 Aug 04 22:38:20.337306 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 654/1298] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:38:20 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:38:21.357840 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-e90c8d5a-afec-4ab4-b3ab-d494bc631914 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:38:21.358454 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-e90c8d5a-afec-4ab4-b3ab-d494bc631914 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:38:21.366065 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e90c8d5a-afec-4ab4-b3ab-d494bc631914 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:21.366496 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e90c8d5a-afec-4ab4-b3ab-d494bc631914 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:21.366932 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e90c8d5a-afec-4ab4-b3ab-d494bc631914 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:21.367625 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e90c8d5a-afec-4ab4-b3ab-d494bc631914 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:21.368080 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e90c8d5a-afec-4ab4-b3ab-d494bc631914 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:21.368506 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-e90c8d5a-afec-4ab4-b3ab-d494bc631914 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:21.511094 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-e90c8d5a-afec-4ab4-b3ab-d494bc631914 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:38:21.520898 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-e90c8d5a-afec-4ab4-b3ab-d494bc631914 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1759 microversion: 2.1 time: 0.167172 Aug 04 22:38:21.521499 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 645/1299] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:38:21 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:38:22.542078 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5b87c6fe-3d7d-4f9d-a546-15f72815ecd9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:38:22.542625 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5b87c6fe-3d7d-4f9d-a546-15f72815ecd9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:38:22.549113 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b87c6fe-3d7d-4f9d-a546-15f72815ecd9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:22.549636 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b87c6fe-3d7d-4f9d-a546-15f72815ecd9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:22.550233 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b87c6fe-3d7d-4f9d-a546-15f72815ecd9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:22.550927 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b87c6fe-3d7d-4f9d-a546-15f72815ecd9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:38:22.551383 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b87c6fe-3d7d-4f9d-a546-15f72815ecd9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:38:22.551852 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b87c6fe-3d7d-4f9d-a546-15f72815ecd9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:38:22.690286 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-5b87c6fe-3d7d-4f9d-a546-15f72815ecd9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:38:22.699010 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5b87c6fe-3d7d-4f9d-a546-15f72815ecd9 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1762 microversion: 2.1 time: 0.160906 Aug 04 22:38:22.699844 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 655/1300] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:38:22 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1762 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:38:42.461325 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:38:42.462050 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Thu Aug 4 22:38:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:38:46.132412 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:38:46.133007 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Thu Aug 4 22:38:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:39:22.626752 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=12 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:22.627506 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:22.631645 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-761226725", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1818150918", "security_groups": [{"name": "tempest-secgroup-smoke-1118840594"}], "block_device_mapping_v2": [{"uuid": "8515213d-8fac-4a5d-9400-45cefe9b7c29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94e914cb-0766-4758-bbaa-283c7e48c0dc"}]}} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:39:22.745048 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.network.neutron [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] validate_networks() for [('94e914cb-0766-4758-bbaa-283c7e48c0dc', None, None, None, None, None)] {{(pid=129197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:39:23.178553 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Flavor limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:39:23.178992 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Image limits 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:39:23.179471 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Flavor pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:39:23.179914 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Image pref 0:0:0 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:39:23.180330 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.virt.hardware [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:39:23.189655 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:23.190176 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:23.190620 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:23.191372 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:23.191819 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:23.192249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:23.209784 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Getting quotas for project 49576f2166cc4b7f9261bd7cbc8384f4. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:39:23.213738 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.quota [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Getting quotas for user 43e543cfa3e1402e9694dcb095a26c00 and project 49576f2166cc4b7f9261bd7cbc8384f4. Resources: {'ram', 'cores', 'instances'} {{(pid=129197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:39:23.270592 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Going to run 1 instances... {{(pid=129197) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:39:23.272849 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8515213d-8fac-4a5d-9400-45cefe9b7c29',volume_size=None,volume_type=None)] {{(pid=129197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:39:23.398229 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b89da12b-0517-44ea-8f7d-ca6c9e293ac8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.773260 Aug 04 22:39:23.398864 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 646/1301] 10.222.0.109 () {60 vars in 1152 bytes} [Thu Aug 4 22:39:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 22:39:23.408186 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=12 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:23.409175 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=36 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:23.413446 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-a29ac1aa-2412-4e2e-9d2b-ed359b266d80 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:23.414320 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-a29ac1aa-2412-4e2e-9d2b-ed359b266d80 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:23.485120 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-a29ac1aa-2412-4e2e-9d2b-ed359b266d80 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:23.492065 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-a29ac1aa-2412-4e2e-9d2b-ed359b266d80 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1097 microversion: 2.1 time: 0.085621 Aug 04 22:39:23.492629 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 656/1302] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:23 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1097 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:24.512776 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-21257567-23e1-4f79-9c56-476d3bff0195 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:24.513381 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-21257567-23e1-4f79-9c56-476d3bff0195 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:24.520407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-21257567-23e1-4f79-9c56-476d3bff0195 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:24.520884 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-21257567-23e1-4f79-9c56-476d3bff0195 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:24.521311 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-21257567-23e1-4f79-9c56-476d3bff0195 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:24.522110 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-21257567-23e1-4f79-9c56-476d3bff0195 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:24.522583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-21257567-23e1-4f79-9c56-476d3bff0195 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:24.522983 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-21257567-23e1-4f79-9c56-476d3bff0195 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:24.586079 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-21257567-23e1-4f79-9c56-476d3bff0195 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:24.593982 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-21257567-23e1-4f79-9c56-476d3bff0195 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1195 microversion: 2.1 time: 0.085766 Aug 04 22:39:24.594542 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 647/1303] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:24 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1195 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:25.618833 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6a30ac84-abbb-4c5e-bf3a-a6a9c3551d6a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:25.619996 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6a30ac84-abbb-4c5e-bf3a-a6a9c3551d6a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:25.629040 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6a30ac84-abbb-4c5e-bf3a-a6a9c3551d6a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:25.629939 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6a30ac84-abbb-4c5e-bf3a-a6a9c3551d6a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:25.630614 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6a30ac84-abbb-4c5e-bf3a-a6a9c3551d6a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:25.631831 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6a30ac84-abbb-4c5e-bf3a-a6a9c3551d6a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:25.632976 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6a30ac84-abbb-4c5e-bf3a-a6a9c3551d6a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:25.633658 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6a30ac84-abbb-4c5e-bf3a-a6a9c3551d6a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:25.804842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6a30ac84-abbb-4c5e-bf3a-a6a9c3551d6a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:25.813895 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6a30ac84-abbb-4c5e-bf3a-a6a9c3551d6a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1281 microversion: 2.1 time: 0.202806 Aug 04 22:39:25.814857 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 657/1304] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:25 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1281 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:26.279906 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-1d4ceaf4-21c3-497d-a318-797f77e5257f req-87201236-b8c2-4511-9c24-4b90ecdca078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc809f4-d5a3-43ab-98bf-50fcd034286f", "tag": "cb43dc45-03a9-418a-b3e0-94b9c12400a7"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:39:26.289749 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e3316249-0c42-4d98-b2d4-f4b6118e285d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1475398053"}} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:39:26.290464 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e3316249-0c42-4d98-b2d4-f4b6118e285d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:26.300914 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e3316249-0c42-4d98-b2d4-f4b6118e285d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:26.301461 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e3316249-0c42-4d98-b2d4-f4b6118e285d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:26.301879 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e3316249-0c42-4d98-b2d4-f4b6118e285d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:26.302584 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e3316249-0c42-4d98-b2d4-f4b6118e285d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:26.303037 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e3316249-0c42-4d98-b2d4-f4b6118e285d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:26.303493 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e3316249-0c42-4d98-b2d4-f4b6118e285d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:26.311708 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-1d4ceaf4-21c3-497d-a318-797f77e5257f req-87201236-b8c2-4511-9c24-4b90ecdca078 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:26.312581 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-1d4ceaf4-21c3-497d-a318-797f77e5257f req-87201236-b8c2-4511-9c24-4b90ecdca078 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:26.313097 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-1d4ceaf4-21c3-497d-a318-797f77e5257f req-87201236-b8c2-4511-9c24-4b90ecdca078 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:26.332272 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-1d4ceaf4-21c3-497d-a318-797f77e5257f req-87201236-b8c2-4511-9c24-4b90ecdca078 service nova] Creating event network-changed:cb43dc45-03a9-418a-b3e0-94b9c12400a7 for instance afc809f4-d5a3-43ab-98bf-50fcd034286f on hv-cinder-85221 Aug 04 22:39:26.337396 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-1d4ceaf4-21c3-497d-a318-797f77e5257f req-87201236-b8c2-4511-9c24-4b90ecdca078 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061173 Aug 04 22:39:26.338092 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 648/1305] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:39:26.438406 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.network.security_group_api [None req-e3316249-0c42-4d98-b2d4-f4b6118e285d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Removing security group 9f1b2279-1b6a-4584-9762-a4c95ff2dd45 from port f0e67f32-c3b1-4fa5-85b0-9006d13726ee Aug 04 22:39:26.752418 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e3316249-0c42-4d98-b2d4-f4b6118e285d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "POST /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/action" status: 202 len: 0 microversion: 2.1 time: 0.467336 Aug 04 22:39:26.756749 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 658/1306] 10.222.0.109 () {60 vars in 1283 bytes} [Thu Aug 4 22:39:26 2022] POST /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:39:26.844060 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-21d39272-a811-48a6-af31-0f5d46423500 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:26.846176 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-21d39272-a811-48a6-af31-0f5d46423500 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:26.860015 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-21d39272-a811-48a6-af31-0f5d46423500 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:26.860587 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-21d39272-a811-48a6-af31-0f5d46423500 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:26.861282 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-21d39272-a811-48a6-af31-0f5d46423500 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:26.862251 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-21d39272-a811-48a6-af31-0f5d46423500 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:26.862909 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-21d39272-a811-48a6-af31-0f5d46423500 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:26.863569 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-21d39272-a811-48a6-af31-0f5d46423500 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:26.891157 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-7f7974e1-6f84-44ca-ae46-4059cf848d7c req-a04b4192-861e-4b02-8ee8-f949f4f1241c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e046be-ac38-431d-94a6-cc0857be49cc", "tag": "f0e67f32-c3b1-4fa5-85b0-9006d13726ee"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:39:26.901789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-7f7974e1-6f84-44ca-ae46-4059cf848d7c req-a04b4192-861e-4b02-8ee8-f949f4f1241c service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:26.902665 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-7f7974e1-6f84-44ca-ae46-4059cf848d7c req-a04b4192-861e-4b02-8ee8-f949f4f1241c service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:26.903294 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-7f7974e1-6f84-44ca-ae46-4059cf848d7c req-a04b4192-861e-4b02-8ee8-f949f4f1241c service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:26.918334 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-7f7974e1-6f84-44ca-ae46-4059cf848d7c req-a04b4192-861e-4b02-8ee8-f949f4f1241c service nova] Creating event network-changed:f0e67f32-c3b1-4fa5-85b0-9006d13726ee for instance d3e046be-ac38-431d-94a6-cc0857be49cc on hv-cinder-85221 Aug 04 22:39:26.924978 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-7f7974e1-6f84-44ca-ae46-4059cf848d7c req-a04b4192-861e-4b02-8ee8-f949f4f1241c service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165887 Aug 04 22:39:26.926313 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 649/1307] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:39:27.100078 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-21d39272-a811-48a6-af31-0f5d46423500 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:27.108277 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-21d39272-a811-48a6-af31-0f5d46423500 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1269 microversion: 2.1 time: 0.276002 Aug 04 22:39:27.109240 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 659/1308] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:26 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1269 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:28.131200 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b1d3e07d-8c80-4cd4-908a-3a7a675395e7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:28.132595 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b1d3e07d-8c80-4cd4-908a-3a7a675395e7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:28.139306 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1d3e07d-8c80-4cd4-908a-3a7a675395e7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:28.139984 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1d3e07d-8c80-4cd4-908a-3a7a675395e7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:28.140299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1d3e07d-8c80-4cd4-908a-3a7a675395e7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:28.141085 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1d3e07d-8c80-4cd4-908a-3a7a675395e7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:28.141576 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1d3e07d-8c80-4cd4-908a-3a7a675395e7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:28.142007 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b1d3e07d-8c80-4cd4-908a-3a7a675395e7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:28.190070 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-f57d423a-9a11-41d4-b564-c46454d27279 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:28.191219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-f57d423a-9a11-41d4-b564-c46454d27279 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:28.198641 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f57d423a-9a11-41d4-b564-c46454d27279 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:28.199377 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f57d423a-9a11-41d4-b564-c46454d27279 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:28.199987 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f57d423a-9a11-41d4-b564-c46454d27279 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:28.201089 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f57d423a-9a11-41d4-b564-c46454d27279 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:28.201899 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f57d423a-9a11-41d4-b564-c46454d27279 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:28.202336 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-f57d423a-9a11-41d4-b564-c46454d27279 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:28.298322 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.objects.instance [None req-f57d423a-9a11-41d4-b564-c46454d27279 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lazy-loading 'services' on Instance uuid d3e046be-ac38-431d-94a6-cc0857be49cc {{(pid=129196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:39:28.387449 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-f57d423a-9a11-41d4-b564-c46454d27279 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "DELETE /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/os-volume_attachments/da80673c-2736-4b14-afbd-66db75602c91" status: 202 len: 0 microversion: 2.1 time: 0.202379 Aug 04 22:39:28.389730 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 660/1309] 10.222.0.109 () {58 vars in 1421 bytes} [Thu Aug 4 22:39:28 2022] DELETE /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/os-volume_attachments/da80673c-2736-4b14-afbd-66db75602c91 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 22:39:28.399291 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-7cc80901-abf8-4287-848a-0fec69537d8a tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:28.403058 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-7cc80901-abf8-4287-848a-0fec69537d8a tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:28.414059 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7cc80901-abf8-4287-848a-0fec69537d8a tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:28.415067 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7cc80901-abf8-4287-848a-0fec69537d8a tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:28.415757 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7cc80901-abf8-4287-848a-0fec69537d8a tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:28.416728 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7cc80901-abf8-4287-848a-0fec69537d8a tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:28.417430 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7cc80901-abf8-4287-848a-0fec69537d8a tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:28.418103 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-7cc80901-abf8-4287-848a-0fec69537d8a tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:28.450614 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b1d3e07d-8c80-4cd4-908a-3a7a675395e7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:28.461919 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b1d3e07d-8c80-4cd4-908a-3a7a675395e7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1269 microversion: 2.1 time: 0.335050 Aug 04 22:39:28.474724 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 650/1310] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:28 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1269 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:28.482273 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-7cc80901-abf8-4287-848a-0fec69537d8a tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088750 Aug 04 22:39:28.487622 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 661/1311] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:39:28 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:39:28.952505 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-6f67fed5-4227-44fa-b14a-a049203cd139 req-c03943ce-eff2-45e4-baf5-18ab14386469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e046be-ac38-431d-94a6-cc0857be49cc", "tag": "f0e67f32-c3b1-4fa5-85b0-9006d13726ee"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:39:28.970856 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-6f67fed5-4227-44fa-b14a-a049203cd139 req-c03943ce-eff2-45e4-baf5-18ab14386469 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:28.971353 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-6f67fed5-4227-44fa-b14a-a049203cd139 req-c03943ce-eff2-45e4-baf5-18ab14386469 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:28.971792 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-6f67fed5-4227-44fa-b14a-a049203cd139 req-c03943ce-eff2-45e4-baf5-18ab14386469 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:28.986071 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-6f67fed5-4227-44fa-b14a-a049203cd139 req-c03943ce-eff2-45e4-baf5-18ab14386469 service nova] Creating event network-changed:f0e67f32-c3b1-4fa5-85b0-9006d13726ee for instance d3e046be-ac38-431d-94a6-cc0857be49cc on hv-cinder-85221 Aug 04 22:39:28.992445 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-6f67fed5-4227-44fa-b14a-a049203cd139 req-c03943ce-eff2-45e4-baf5-18ab14386469 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043471 Aug 04 22:39:28.993211 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 651/1312] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:39:29.484947 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-74fe5f3c-f3ec-48b9-8343-802c8d477d03 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:29.485636 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-74fe5f3c-f3ec-48b9-8343-802c8d477d03 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:29.492250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-74fe5f3c-f3ec-48b9-8343-802c8d477d03 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:29.492740 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-74fe5f3c-f3ec-48b9-8343-802c8d477d03 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:29.493181 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-74fe5f3c-f3ec-48b9-8343-802c8d477d03 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:29.493912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-74fe5f3c-f3ec-48b9-8343-802c8d477d03 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:29.494366 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-74fe5f3c-f3ec-48b9-8343-802c8d477d03 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:29.494795 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-74fe5f3c-f3ec-48b9-8343-802c8d477d03 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:29.495941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-889c7f4e-4956-44b6-9c4b-be663bdbd1fa tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:29.498842 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-889c7f4e-4956-44b6-9c4b-be663bdbd1fa tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:29.504978 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-889c7f4e-4956-44b6-9c4b-be663bdbd1fa tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:29.505503 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-889c7f4e-4956-44b6-9c4b-be663bdbd1fa tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:29.505993 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-889c7f4e-4956-44b6-9c4b-be663bdbd1fa tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:29.506698 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-889c7f4e-4956-44b6-9c4b-be663bdbd1fa tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:29.507344 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-889c7f4e-4956-44b6-9c4b-be663bdbd1fa tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:29.507773 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-889c7f4e-4956-44b6-9c4b-be663bdbd1fa tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:29.537271 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-889c7f4e-4956-44b6-9c4b-be663bdbd1fa tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046085 Aug 04 22:39:29.537876 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 652/1313] 10.222.0.109 () {58 vars in 1307 bytes} [Thu Aug 4 22:39:29 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 22:39:29.548935 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-46b38cc3-8d4b-4809-a0d1-e50be8abeaa8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:29.549462 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-46b38cc3-8d4b-4809-a0d1-e50be8abeaa8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:29.555528 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-46b38cc3-8d4b-4809-a0d1-e50be8abeaa8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:29.556014 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-46b38cc3-8d4b-4809-a0d1-e50be8abeaa8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:29.556452 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-46b38cc3-8d4b-4809-a0d1-e50be8abeaa8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:29.557150 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-46b38cc3-8d4b-4809-a0d1-e50be8abeaa8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:29.557634 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-46b38cc3-8d4b-4809-a0d1-e50be8abeaa8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:29.558058 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-46b38cc3-8d4b-4809-a0d1-e50be8abeaa8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:29.636257 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-46b38cc3-8d4b-4809-a0d1-e50be8abeaa8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] HTTP exception thrown: Instance d3e046be-ac38-431d-94a6-cc0857be49cc is not attached to volume da80673c-2736-4b14-afbd-66db75602c91 Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-46b38cc3-8d4b-4809-a0d1-e50be8abeaa8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Request method failure captured: Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: DELETE /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/os-volume_attachments/da80673c-2736-4b14-afbd-66db75602c91 HTTP/1.1 Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EniIqW5Yi-1gPr2fTz5BoiYmmPlHZfTVuTjnL-tlmMpnjQfZK7hnRVAvM3Q__NEYBHxpQxbzP1BLPXjNKxuAZ01hQEKRjCQgJmqTJuXguAXfaGfljlxhXrWADuDBEjK8cROMeumqN0VbVE6nyWjb-pXEItbLCijvv6JLlqOII0z6dM Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 34dc6542be764622b304ee5f895041a2 Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-TestMinimumBasicScenario-357175166 Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:39:29.638859 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:39:29.640680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/34dc6542be764622b304ee5f895041a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_34dc6542be764622b304ee5f895041a2", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/34dc6542be764622b304ee5f895041a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/34dc6542be764622b304ee5f895041a2"}]}] Aug 04 22:39:29.640680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-TestMinimumBasicScenario-357175166 Aug 04 22:39:29.640680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 34dc6542be764622b304ee5f895041a2 Aug 04 22:39:29.640680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-TestMinimumBasicScenario-357175166 Aug 04 22:39:29.640680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-TestMinimumBasicScenario-357175166-project Aug 04 22:39:29.640680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:39:29.640680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:39:29.640680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 285c9f1fe752403fb7374b490391384e Aug 04 22:39:29.640680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-TestMinimumBasicScenario-357175166-project Aug 04 22:39:29.640680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:39:29.640680 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance d3e046be-ac38-431d-94a6-cc0857be49cc is not attached to volume da80673c-2736-4b14-afbd-66db75602c91 Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'server_id': 'd3e046be-ac38-431d-94a6-cc0857be49cc', 'id': 'da80673c-2736-4b14-afbd-66db75602c91'} Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id da80673c-2736-4b14-afbd-66db75602c91. Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:39:29.641602 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3e046be-ac38-431d-94a6-cc0857be49cc is not attached to volume da80673c-2736-4b14-afbd-66db75602c91 Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3e046be-ac38-431d-94a6-cc0857be49cc is not attached to volume da80673c-2736-4b14-afbd-66db75602c91 Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:39:29.643279 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-46b38cc3-8d4b-4809-a0d1-e50be8abeaa8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Returning 404 to user: Instance d3e046be-ac38-431d-94a6-cc0857be49cc is not attached to volume da80673c-2736-4b14-afbd-66db75602c91 {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:39:29.644577 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-46b38cc3-8d4b-4809-a0d1-e50be8abeaa8 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "DELETE /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/os-volume_attachments/da80673c-2736-4b14-afbd-66db75602c91" status: 404 len: 154 microversion: 2.1 time: 0.096109 Aug 04 22:39:29.644577 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 653/1314] 10.222.0.109 () {58 vars in 1421 bytes} [Thu Aug 4 22:39:29 2022] DELETE /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc/os-volume_attachments/da80673c-2736-4b14-afbd-66db75602c91 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:39:29.729557 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-74fe5f3c-f3ec-48b9-8343-802c8d477d03 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:29.740006 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-74fe5f3c-f3ec-48b9-8343-802c8d477d03 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1269 microversion: 2.1 time: 0.259551 Aug 04 22:39:29.740857 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 662/1315] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:29 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1269 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:30.760523 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-716fa9a6-9ff6-4a20-bebe-8aeec72568cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:30.761130 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-716fa9a6-9ff6-4a20-bebe-8aeec72568cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:30.768346 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-716fa9a6-9ff6-4a20-bebe-8aeec72568cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:30.769070 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-716fa9a6-9ff6-4a20-bebe-8aeec72568cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:30.769243 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-716fa9a6-9ff6-4a20-bebe-8aeec72568cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:30.769962 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-716fa9a6-9ff6-4a20-bebe-8aeec72568cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:30.770411 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-716fa9a6-9ff6-4a20-bebe-8aeec72568cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:30.770829 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-716fa9a6-9ff6-4a20-bebe-8aeec72568cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:30.795268 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5b724bc8-973c-4569-91ce-f00e7ecb7fc6 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:30.795812 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5b724bc8-973c-4569-91ce-f00e7ecb7fc6 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:30.801696 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b724bc8-973c-4569-91ce-f00e7ecb7fc6 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:30.802181 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b724bc8-973c-4569-91ce-f00e7ecb7fc6 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:30.802617 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b724bc8-973c-4569-91ce-f00e7ecb7fc6 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:30.803322 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b724bc8-973c-4569-91ce-f00e7ecb7fc6 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:30.803766 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b724bc8-973c-4569-91ce-f00e7ecb7fc6 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:30.804189 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5b724bc8-973c-4569-91ce-f00e7ecb7fc6 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:30.830971 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5b724bc8-973c-4569-91ce-f00e7ecb7fc6 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Going to try to terminate instance {{(pid=129196) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:39:30.911665 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5b724bc8-973c-4569-91ce-f00e7ecb7fc6 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "DELETE /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 204 len: 0 microversion: 2.1 time: 0.120703 Aug 04 22:39:30.912427 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 663/1316] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:39:30 2022] DELETE /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:39:30.921337 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-6888795b-9258-4340-8f17-43ebb81bb45d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:30.922103 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-6888795b-9258-4340-8f17-43ebb81bb45d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:30.924147 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-716fa9a6-9ff6-4a20-bebe-8aeec72568cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:30.927934 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6888795b-9258-4340-8f17-43ebb81bb45d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:30.928414 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6888795b-9258-4340-8f17-43ebb81bb45d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:30.928843 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6888795b-9258-4340-8f17-43ebb81bb45d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:30.929570 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6888795b-9258-4340-8f17-43ebb81bb45d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:30.930016 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6888795b-9258-4340-8f17-43ebb81bb45d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:30.930437 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-6888795b-9258-4340-8f17-43ebb81bb45d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:30.931627 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-716fa9a6-9ff6-4a20-bebe-8aeec72568cd tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1269 microversion: 2.1 time: 0.174906 Aug 04 22:39:30.932185 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 654/1317] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:30 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:31.062307 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-6888795b-9258-4340-8f17-43ebb81bb45d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:31.069800 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-6888795b-9258-4340-8f17-43ebb81bb45d tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1557 microversion: 2.1 time: 0.152987 Aug 04 22:39:31.070396 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 664/1318] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:30 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:39:31.953480 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-80481181-fb9c-45cc-9386-6e0a9c9728cf tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:31.954085 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-80481181-fb9c-45cc-9386-6e0a9c9728cf tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:31.960399 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-80481181-fb9c-45cc-9386-6e0a9c9728cf tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:31.960886 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-80481181-fb9c-45cc-9386-6e0a9c9728cf tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:31.961319 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-80481181-fb9c-45cc-9386-6e0a9c9728cf tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:31.962033 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-80481181-fb9c-45cc-9386-6e0a9c9728cf tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:31.962485 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-80481181-fb9c-45cc-9386-6e0a9c9728cf tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:31.962906 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-80481181-fb9c-45cc-9386-6e0a9c9728cf tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:32.091373 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-dc32a46a-7061-474a-95ac-18f40305a5ce tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:32.092458 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-dc32a46a-7061-474a-95ac-18f40305a5ce tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:32.095998 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-80481181-fb9c-45cc-9386-6e0a9c9728cf tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:32.099231 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc32a46a-7061-474a-95ac-18f40305a5ce tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:32.099733 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc32a46a-7061-474a-95ac-18f40305a5ce tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:32.100163 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc32a46a-7061-474a-95ac-18f40305a5ce tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:32.100873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc32a46a-7061-474a-95ac-18f40305a5ce tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:32.101328 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc32a46a-7061-474a-95ac-18f40305a5ce tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:32.101802 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-dc32a46a-7061-474a-95ac-18f40305a5ce tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:32.103645 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-80481181-fb9c-45cc-9386-6e0a9c9728cf tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1269 microversion: 2.1 time: 0.154656 Aug 04 22:39:32.114142 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 655/1319] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:31 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:32.228965 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-dc32a46a-7061-474a-95ac-18f40305a5ce tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:32.236741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-dc32a46a-7061-474a-95ac-18f40305a5ce tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1557 microversion: 2.1 time: 0.149206 Aug 04 22:39:32.237315 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 665/1320] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:32 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:39:33.124936 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-d62e6a9c-23b5-4d32-88e7-ed0d84441d6f tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:33.125599 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-d62e6a9c-23b5-4d32-88e7-ed0d84441d6f tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:33.132314 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d62e6a9c-23b5-4d32-88e7-ed0d84441d6f tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:33.132821 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d62e6a9c-23b5-4d32-88e7-ed0d84441d6f tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:33.133259 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d62e6a9c-23b5-4d32-88e7-ed0d84441d6f tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:33.133990 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d62e6a9c-23b5-4d32-88e7-ed0d84441d6f tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:33.134447 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d62e6a9c-23b5-4d32-88e7-ed0d84441d6f tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:33.134980 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-d62e6a9c-23b5-4d32-88e7-ed0d84441d6f tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:33.202007 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=2 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:33.221359 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell0:SELECT=6 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:33.258580 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-c4b9a559-f03a-4e2e-aa84-7dd061a60269 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:33.259195 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-c4b9a559-f03a-4e2e-aa84-7dd061a60269 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:33.266793 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c4b9a559-f03a-4e2e-aa84-7dd061a60269 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:33.267280 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c4b9a559-f03a-4e2e-aa84-7dd061a60269 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:33.267714 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c4b9a559-f03a-4e2e-aa84-7dd061a60269 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:33.268408 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c4b9a559-f03a-4e2e-aa84-7dd061a60269 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:33.268858 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c4b9a559-f03a-4e2e-aa84-7dd061a60269 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:33.269285 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-c4b9a559-f03a-4e2e-aa84-7dd061a60269 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:33.300418 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-d62e6a9c-23b5-4d32-88e7-ed0d84441d6f tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:33.308067 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-d62e6a9c-23b5-4d32-88e7-ed0d84441d6f tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1269 microversion: 2.1 time: 0.187714 Aug 04 22:39:33.308644 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 656/1321] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:33 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:33.397842 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-c4b9a559-f03a-4e2e-aa84-7dd061a60269 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:33.406084 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-c4b9a559-f03a-4e2e-aa84-7dd061a60269 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1557 microversion: 2.1 time: 0.151379 Aug 04 22:39:33.406649 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 666/1322] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:33 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:39:34.330074 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-b17ff0d1-ed49-496c-98bb-8e25e6da2171 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:34.331452 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-b17ff0d1-ed49-496c-98bb-8e25e6da2171 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:34.338898 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b17ff0d1-ed49-496c-98bb-8e25e6da2171 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:34.339697 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b17ff0d1-ed49-496c-98bb-8e25e6da2171 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:34.340357 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b17ff0d1-ed49-496c-98bb-8e25e6da2171 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:34.342488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b17ff0d1-ed49-496c-98bb-8e25e6da2171 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:34.343225 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b17ff0d1-ed49-496c-98bb-8e25e6da2171 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:34.343703 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-b17ff0d1-ed49-496c-98bb-8e25e6da2171 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:34.427055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-582fdd84-f1d3-47a2-8c58-a593ed7e5ce4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:34.429314 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-582fdd84-f1d3-47a2-8c58-a593ed7e5ce4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:34.437653 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell0:SELECT=2 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:34.440521 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-582fdd84-f1d3-47a2-8c58-a593ed7e5ce4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:34.441213 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-582fdd84-f1d3-47a2-8c58-a593ed7e5ce4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:34.441937 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-582fdd84-f1d3-47a2-8c58-a593ed7e5ce4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:34.442708 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-582fdd84-f1d3-47a2-8c58-a593ed7e5ce4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:34.454503 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-582fdd84-f1d3-47a2-8c58-a593ed7e5ce4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:34.456767 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-582fdd84-f1d3-47a2-8c58-a593ed7e5ce4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:34.572115 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-b17ff0d1-ed49-496c-98bb-8e25e6da2171 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:34.580798 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-b17ff0d1-ed49-496c-98bb-8e25e6da2171 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1269 microversion: 2.1 time: 0.255357 Aug 04 22:39:34.585848 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 657/1323] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:34 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1269 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:34.605106 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-582fdd84-f1d3-47a2-8c58-a593ed7e5ce4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285c9f1fe752403fb7374b490391384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dc6542be764622b304ee5f895041a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:34.613365 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-582fdd84-f1d3-47a2-8c58-a593ed7e5ce4 tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 200 len: 1557 microversion: 2.1 time: 0.190565 Aug 04 22:39:34.614027 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 667/1324] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:34 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 1557 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:34.730369 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-9b779728-3c6a-4e09-aa2d-ed294d887f26 req-b61cc9c8-1247-4a5b-ba52-4bed33687939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e046be-ac38-431d-94a6-cc0857be49cc", "name": "network-vif-deleted", "tag": "f0e67f32-c3b1-4fa5-85b0-9006d13726ee"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:39:34.739789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-9b779728-3c6a-4e09-aa2d-ed294d887f26 req-b61cc9c8-1247-4a5b-ba52-4bed33687939 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:34.740268 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-9b779728-3c6a-4e09-aa2d-ed294d887f26 req-b61cc9c8-1247-4a5b-ba52-4bed33687939 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:34.740748 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-9b779728-3c6a-4e09-aa2d-ed294d887f26 req-b61cc9c8-1247-4a5b-ba52-4bed33687939 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:34.751869 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-9b779728-3c6a-4e09-aa2d-ed294d887f26 req-b61cc9c8-1247-4a5b-ba52-4bed33687939 service nova] Creating event network-vif-deleted:f0e67f32-c3b1-4fa5-85b0-9006d13726ee for instance d3e046be-ac38-431d-94a6-cc0857be49cc on hv-cinder-85221 Aug 04 22:39:34.757345 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-9b779728-3c6a-4e09-aa2d-ed294d887f26 req-b61cc9c8-1247-4a5b-ba52-4bed33687939 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030703 Aug 04 22:39:34.757984 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 658/1325] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:39:35.601850 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-847181a4-38e6-4d9a-bb49-cfb9dcbb2155 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:35.602462 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-847181a4-38e6-4d9a-bb49-cfb9dcbb2155 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:35.609341 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-847181a4-38e6-4d9a-bb49-cfb9dcbb2155 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:35.609854 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-847181a4-38e6-4d9a-bb49-cfb9dcbb2155 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:35.610290 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-847181a4-38e6-4d9a-bb49-cfb9dcbb2155 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:35.610982 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-847181a4-38e6-4d9a-bb49-cfb9dcbb2155 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:35.611432 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-847181a4-38e6-4d9a-bb49-cfb9dcbb2155 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:35.611856 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-847181a4-38e6-4d9a-bb49-cfb9dcbb2155 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:35.640414 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6693efda-77d3-4387-a495-d48762ac0b5b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:35.641742 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-6693efda-77d3-4387-a495-d48762ac0b5b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] [instance: d3e046be-ac38-431d-94a6-cc0857be49cc] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:35.651266 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6693efda-77d3-4387-a495-d48762ac0b5b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:35.651762 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6693efda-77d3-4387-a495-d48762ac0b5b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:35.652208 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6693efda-77d3-4387-a495-d48762ac0b5b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:35.652920 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6693efda-77d3-4387-a495-d48762ac0b5b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:35.653389 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6693efda-77d3-4387-a495-d48762ac0b5b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:35.653843 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-6693efda-77d3-4387-a495-d48762ac0b5b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:35.669755 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-6693efda-77d3-4387-a495-d48762ac0b5b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] HTTP exception thrown: Instance d3e046be-ac38-431d-94a6-cc0857be49cc could not be found. Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6693efda-77d3-4387-a495-d48762ac0b5b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Request method failure captured: Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc HTTP/1.1 Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7EniIqW5Yi-1gPr2fTz5BoiYmmPlHZfTVuTjnL-tlmMpnjQfZK7hnRVAvM3Q__NEYBHxpQxbzP1BLPXjNKxuAZ01hQEKRjCQgJmqTJuXguAXfaGfljlxhXrWADuDBEjK8cROMeumqN0VbVE6nyWjb-pXEItbLCijvv6JLlqOII0z6dM Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 34dc6542be764622b304ee5f895041a2 Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-TestMinimumBasicScenario-357175166 Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:39:35.671583 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:39:35.673384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/34dc6542be764622b304ee5f895041a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_34dc6542be764622b304ee5f895041a2", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/34dc6542be764622b304ee5f895041a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/34dc6542be764622b304ee5f895041a2"}]}] Aug 04 22:39:35.673384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-TestMinimumBasicScenario-357175166 Aug 04 22:39:35.673384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 34dc6542be764622b304ee5f895041a2 Aug 04 22:39:35.673384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-TestMinimumBasicScenario-357175166 Aug 04 22:39:35.673384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-TestMinimumBasicScenario-357175166-project Aug 04 22:39:35.673384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:39:35.673384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:39:35.673384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 285c9f1fe752403fb7374b490391384e Aug 04 22:39:35.673384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-TestMinimumBasicScenario-357175166-project Aug 04 22:39:35.673384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:39:35.673384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance d3e046be-ac38-431d-94a6-cc0857be49cc could not be found. Aug 04 22:39:35.673384 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': 'd3e046be-ac38-431d-94a6-cc0857be49cc'} Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3e046be-ac38-431d-94a6-cc0857be49cc could not be found. Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:39:35.674377 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3e046be-ac38-431d-94a6-cc0857be49cc could not be found. Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3e046be-ac38-431d-94a6-cc0857be49cc could not be found. Aug 04 22:39:35.676031 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:39:35.677572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-6693efda-77d3-4387-a495-d48762ac0b5b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Returning 404 to user: Instance d3e046be-ac38-431d-94a6-cc0857be49cc could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:39:35.677572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-6693efda-77d3-4387-a495-d48762ac0b5b tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc" status: 404 len: 111 microversion: 2.1 time: 0.040337 Aug 04 22:39:35.677572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 659/1326] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:35 2022] GET /compute/v2.1/servers/d3e046be-ac38-431d-94a6-cc0857be49cc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 22:39:35.681363 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-9abdc7a0-4ce9-4b92-a741-8a29e0317b2f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] Calling method '.version_select at 0x7fe7b178a8b0>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:35.702538 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-9abdc7a0-4ce9-4b92-a741-8a29e0317b2f tempest-TestMinimumBasicScenario-357175166 tempest-TestMinimumBasicScenario-357175166-project] 10.222.0.109 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-297183883" status: 202 len: 0 microversion: 2.1 time: 0.024691 Aug 04 22:39:35.703124 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 660/1327] 10.222.0.109 () {58 vars in 1274 bytes} [Thu Aug 4 22:39:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-297183883 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:39:35.749471 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-847181a4-38e6-4d9a-bb49-cfb9dcbb2155 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:35.756923 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-847181a4-38e6-4d9a-bb49-cfb9dcbb2155 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1269 microversion: 2.1 time: 0.158857 Aug 04 22:39:35.757501 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 668/1328] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:35 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:36.402483 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [req-edf1cf1a-7bd4-4cdb-8571-0ac7cc6433e6 req-42a89eb0-9da6-4bae-8ff9-5af5f87c5de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc809f4-d5a3-43ab-98bf-50fcd034286f", "name": "network-vif-plugged", "status": "completed", "tag": "cb43dc45-03a9-418a-b3e0-94b9c12400a7"}]} {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:39:36.414012 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-edf1cf1a-7bd4-4cdb-8571-0ac7cc6433e6 req-42a89eb0-9da6-4bae-8ff9-5af5f87c5de3 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:36.414535 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-edf1cf1a-7bd4-4cdb-8571-0ac7cc6433e6 req-42a89eb0-9da6-4bae-8ff9-5af5f87c5de3 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:36.415159 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [req-edf1cf1a-7bd4-4cdb-8571-0ac7cc6433e6 req-42a89eb0-9da6-4bae-8ff9-5af5f87c5de3 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:36.426027 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.compute.server_external_events [req-edf1cf1a-7bd4-4cdb-8571-0ac7cc6433e6 req-42a89eb0-9da6-4bae-8ff9-5af5f87c5de3 service nova] Creating event network-vif-plugged:cb43dc45-03a9-418a-b3e0-94b9c12400a7 for instance afc809f4-d5a3-43ab-98bf-50fcd034286f on hv-cinder-85221 Aug 04 22:39:36.431457 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [req-edf1cf1a-7bd4-4cdb-8571-0ac7cc6433e6 req-42a89eb0-9da6-4bae-8ff9-5af5f87c5de3 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032984 Aug 04 22:39:36.432486 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 661/1329] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:39:36.777818 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-2ba629ea-4886-46a6-b317-4df5729add90 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:36.779014 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-2ba629ea-4886-46a6-b317-4df5729add90 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:36.785377 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2ba629ea-4886-46a6-b317-4df5729add90 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:36.785888 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2ba629ea-4886-46a6-b317-4df5729add90 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:36.786320 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2ba629ea-4886-46a6-b317-4df5729add90 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:36.787017 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2ba629ea-4886-46a6-b317-4df5729add90 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:36.787466 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2ba629ea-4886-46a6-b317-4df5729add90 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:36.787893 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-2ba629ea-4886-46a6-b317-4df5729add90 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:36.933921 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-2ba629ea-4886-46a6-b317-4df5729add90 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:36.941731 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-2ba629ea-4886-46a6-b317-4df5729add90 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1269 microversion: 2.1 time: 0.167698 Aug 04 22:39:36.942301 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 669/1330] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:36 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:37.964560 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-623b8193-65f3-434f-906a-0430680016f4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:37.966411 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-623b8193-65f3-434f-906a-0430680016f4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:37.973352 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-623b8193-65f3-434f-906a-0430680016f4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:37.974112 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-623b8193-65f3-434f-906a-0430680016f4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:37.974731 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-623b8193-65f3-434f-906a-0430680016f4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:37.975654 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-623b8193-65f3-434f-906a-0430680016f4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:37.976119 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-623b8193-65f3-434f-906a-0430680016f4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:37.976554 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-623b8193-65f3-434f-906a-0430680016f4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:38.197679 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-623b8193-65f3-434f-906a-0430680016f4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:38.206007 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-623b8193-65f3-434f-906a-0430680016f4 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1269 microversion: 2.1 time: 0.246458 Aug 04 22:39:38.206911 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 662/1331] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:37 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1269 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:39.227785 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-82dd9d0e-8b41-4dd6-8f70-6282e3433bac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:39.228406 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-82dd9d0e-8b41-4dd6-8f70-6282e3433bac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:39.235733 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-82dd9d0e-8b41-4dd6-8f70-6282e3433bac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:39.236219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-82dd9d0e-8b41-4dd6-8f70-6282e3433bac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:39.236657 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-82dd9d0e-8b41-4dd6-8f70-6282e3433bac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:39.237388 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-82dd9d0e-8b41-4dd6-8f70-6282e3433bac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:39.237869 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-82dd9d0e-8b41-4dd6-8f70-6282e3433bac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:39.238340 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-82dd9d0e-8b41-4dd6-8f70-6282e3433bac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:39.416023 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-82dd9d0e-8b41-4dd6-8f70-6282e3433bac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:39.424397 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-82dd9d0e-8b41-4dd6-8f70-6282e3433bac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1455 microversion: 2.1 time: 0.200513 Aug 04 22:39:39.425181 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 670/1332] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:39 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1455 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:39.446420 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-76e316b4-b74f-42aa-87a4-34080fee4ce7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:39:39.447044 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-76e316b4-b74f-42aa-87a4-34080fee4ce7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:39:39.456572 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-76e316b4-b74f-42aa-87a4-34080fee4ce7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:39.457109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-76e316b4-b74f-42aa-87a4-34080fee4ce7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:39.457568 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-76e316b4-b74f-42aa-87a4-34080fee4ce7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:39.458249 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-76e316b4-b74f-42aa-87a4-34080fee4ce7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:39.458709 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-76e316b4-b74f-42aa-87a4-34080fee4ce7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:39.459218 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-76e316b4-b74f-42aa-87a4-34080fee4ce7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:39.684914 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-76e316b4-b74f-42aa-87a4-34080fee4ce7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:39:39.700492 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-76e316b4-b74f-42aa-87a4-34080fee4ce7 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1455 microversion: 2.1 time: 0.257462 Aug 04 22:39:39.701749 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 663/1333] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:39:39 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1455 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:39:41.831397 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-45ffa327-98a0-43c9-a048-bf4106db29c1 req-ee746916-9397-40e5-99c7-3bc11ffe49b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc809f4-d5a3-43ab-98bf-50fcd034286f", "tag": "cb43dc45-03a9-418a-b3e0-94b9c12400a7"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:39:41.844159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-45ffa327-98a0-43c9-a048-bf4106db29c1 req-ee746916-9397-40e5-99c7-3bc11ffe49b7 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:39:41.844896 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-45ffa327-98a0-43c9-a048-bf4106db29c1 req-ee746916-9397-40e5-99c7-3bc11ffe49b7 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:39:41.845575 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-45ffa327-98a0-43c9-a048-bf4106db29c1 req-ee746916-9397-40e5-99c7-3bc11ffe49b7 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:39:41.867706 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-45ffa327-98a0-43c9-a048-bf4106db29c1 req-ee746916-9397-40e5-99c7-3bc11ffe49b7 service nova] Creating event network-changed:cb43dc45-03a9-418a-b3e0-94b9c12400a7 for instance afc809f4-d5a3-43ab-98bf-50fcd034286f on hv-cinder-85221 Aug 04 22:39:41.874598 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-45ffa327-98a0-43c9-a048-bf4106db29c1 req-ee746916-9397-40e5-99c7-3bc11ffe49b7 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051918 Aug 04 22:39:41.875858 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 671/1334] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:41:33.274933 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:41:33.276261 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG dbcounter [-] [129197] Writing DB stats nova_cell1:SELECT=74 {{(pid=129197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:41:33.277174 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR oslo.messaging._drivers.impl_rabbit [-] [80c9789a-8de0-4cc4-8b46-6bbd3a6e44d2] AMQP server on 10.222.0.109:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 22:41:33.278173 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:41:33.279162 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG dbcounter [-] [129196] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:41:33.280785 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-30e6605b-d93b-475e-93b4-5e18acb1ce3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:41:33.281452 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-30e6605b-d93b-475e-93b4-5e18acb1ce3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:41:33.284873 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-50af1cc1-b8cf-41dc-a94d-deec16d39982 req-69329676-929e-4689-9047-dfc62948a007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc809f4-d5a3-43ab-98bf-50fcd034286f", "tag": "cb43dc45-03a9-418a-b3e0-94b9c12400a7"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:41:33.289884 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-30e6605b-d93b-475e-93b4-5e18acb1ce3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:33.290410 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-30e6605b-d93b-475e-93b4-5e18acb1ce3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:33.291330 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-30e6605b-d93b-475e-93b4-5e18acb1ce3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:33.291710 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-30e6605b-d93b-475e-93b4-5e18acb1ce3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:33.292176 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-30e6605b-d93b-475e-93b4-5e18acb1ce3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:33.292600 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-30e6605b-d93b-475e-93b4-5e18acb1ce3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:33.297454 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-50af1cc1-b8cf-41dc-a94d-deec16d39982 req-69329676-929e-4689-9047-dfc62948a007 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:33.297765 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-50af1cc1-b8cf-41dc-a94d-deec16d39982 req-69329676-929e-4689-9047-dfc62948a007 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:33.298189 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-50af1cc1-b8cf-41dc-a94d-deec16d39982 req-69329676-929e-4689-9047-dfc62948a007 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:33.312859 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-50af1cc1-b8cf-41dc-a94d-deec16d39982 req-69329676-929e-4689-9047-dfc62948a007 service nova] Creating event network-changed:cb43dc45-03a9-418a-b3e0-94b9c12400a7 for instance afc809f4-d5a3-43ab-98bf-50fcd034286f on hv-cinder-85221 Aug 04 22:41:33.318439 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-50af1cc1-b8cf-41dc-a94d-deec16d39982 req-69329676-929e-4689-9047-dfc62948a007 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043348 Aug 04 22:41:33.319315 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 672/1335] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:41:33.321935 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-30e6605b-d93b-475e-93b4-5e18acb1ce3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Going to try to terminate instance {{(pid=129197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:41:33.410863 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-30e6605b-d93b-475e-93b4-5e18acb1ce3d tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "DELETE /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 204 len: 0 microversion: 2.1 time: 0.137800 Aug 04 22:41:33.412299 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 664/1336] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:41:33 2022] DELETE /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:41:33.422884 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-45af3a12-f64f-423b-aafb-3af6f58ba396 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:41:33.423587 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-45af3a12-f64f-423b-aafb-3af6f58ba396 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:41:33.430589 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45af3a12-f64f-423b-aafb-3af6f58ba396 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:33.431055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45af3a12-f64f-423b-aafb-3af6f58ba396 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:33.431490 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45af3a12-f64f-423b-aafb-3af6f58ba396 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:33.432210 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45af3a12-f64f-423b-aafb-3af6f58ba396 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:33.432717 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45af3a12-f64f-423b-aafb-3af6f58ba396 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:33.433184 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-45af3a12-f64f-423b-aafb-3af6f58ba396 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:33.713982 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-45af3a12-f64f-423b-aafb-3af6f58ba396 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:41:33.722900 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-45af3a12-f64f-423b-aafb-3af6f58ba396 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1580 microversion: 2.1 time: 0.305698 Aug 04 22:41:33.723484 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 673/1337] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:41:33 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1580 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:41:34.745183 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-3a53ee1c-51da-4061-a051-c83d3aa9c5ae tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:41:34.745912 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-3a53ee1c-51da-4061-a051-c83d3aa9c5ae tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:41:34.752305 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3a53ee1c-51da-4061-a051-c83d3aa9c5ae tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:34.752784 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3a53ee1c-51da-4061-a051-c83d3aa9c5ae tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:34.753359 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3a53ee1c-51da-4061-a051-c83d3aa9c5ae tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:34.754027 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3a53ee1c-51da-4061-a051-c83d3aa9c5ae tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:34.754480 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3a53ee1c-51da-4061-a051-c83d3aa9c5ae tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:34.754901 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-3a53ee1c-51da-4061-a051-c83d3aa9c5ae tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:34.968382 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-3a53ee1c-51da-4061-a051-c83d3aa9c5ae tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:41:34.976503 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-3a53ee1c-51da-4061-a051-c83d3aa9c5ae tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1580 microversion: 2.1 time: 0.235575 Aug 04 22:41:34.977067 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 665/1338] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:41:34 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1580 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:41:35.709291 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-bae0ec75-2d76-4a71-8788-7b709b0ec4b7 req-71fad813-36a0-4728-a9dd-976e0c7ef98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc809f4-d5a3-43ab-98bf-50fcd034286f", "name": "network-vif-deleted", "tag": "cb43dc45-03a9-418a-b3e0-94b9c12400a7"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:41:35.720824 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-bae0ec75-2d76-4a71-8788-7b709b0ec4b7 req-71fad813-36a0-4728-a9dd-976e0c7ef98c service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:35.721303 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-bae0ec75-2d76-4a71-8788-7b709b0ec4b7 req-71fad813-36a0-4728-a9dd-976e0c7ef98c service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:35.721796 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-bae0ec75-2d76-4a71-8788-7b709b0ec4b7 req-71fad813-36a0-4728-a9dd-976e0c7ef98c service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:35.733683 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-bae0ec75-2d76-4a71-8788-7b709b0ec4b7 req-71fad813-36a0-4728-a9dd-976e0c7ef98c service nova] Creating event network-vif-deleted:cb43dc45-03a9-418a-b3e0-94b9c12400a7 for instance afc809f4-d5a3-43ab-98bf-50fcd034286f on hv-cinder-85221 Aug 04 22:41:35.738000 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO oslo.messaging._drivers.impl_rabbit [-] [80c9789a-8de0-4cc4-8b46-6bbd3a6e44d2] Reconnected to AMQP server on 10.222.0.109:5672 via [amqp] client with port 37534. Aug 04 22:41:35.739741 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-bae0ec75-2d76-4a71-8788-7b709b0ec4b7 req-71fad813-36a0-4728-a9dd-976e0c7ef98c service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034107 Aug 04 22:41:35.740535 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 674/1339] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:41:35.997540 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-ab986aaf-c7f6-4ffd-a7b2-473514eb7b26 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:41:35.998172 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-ab986aaf-c7f6-4ffd-a7b2-473514eb7b26 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:41:36.005989 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ab986aaf-c7f6-4ffd-a7b2-473514eb7b26 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:36.006488 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ab986aaf-c7f6-4ffd-a7b2-473514eb7b26 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:36.006929 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ab986aaf-c7f6-4ffd-a7b2-473514eb7b26 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:36.007649 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ab986aaf-c7f6-4ffd-a7b2-473514eb7b26 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:36.008140 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ab986aaf-c7f6-4ffd-a7b2-473514eb7b26 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:36.008568 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-ab986aaf-c7f6-4ffd-a7b2-473514eb7b26 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:36.075061 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-ab986aaf-c7f6-4ffd-a7b2-473514eb7b26 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:41:36.084824 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-ab986aaf-c7f6-4ffd-a7b2-473514eb7b26 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 200 len: 1228 microversion: 2.1 time: 0.091402 Aug 04 22:41:36.085430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 666/1340] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:41:35 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 1228 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:41:37.105736 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5ae637e0-3764-4826-976b-ebea3b9946ac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:41:37.106440 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-5ae637e0-3764-4826-976b-ebea3b9946ac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: afc809f4-d5a3-43ab-98bf-50fcd034286f] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:41:37.112896 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5ae637e0-3764-4826-976b-ebea3b9946ac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:37.113379 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5ae637e0-3764-4826-976b-ebea3b9946ac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:37.113855 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5ae637e0-3764-4826-976b-ebea3b9946ac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:37.114554 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5ae637e0-3764-4826-976b-ebea3b9946ac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:37.115011 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5ae637e0-3764-4826-976b-ebea3b9946ac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:37.115443 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-5ae637e0-3764-4826-976b-ebea3b9946ac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:37.129071 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-5ae637e0-3764-4826-976b-ebea3b9946ac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] HTTP exception thrown: Instance afc809f4-d5a3-43ab-98bf-50fcd034286f could not be found. Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5ae637e0-3764-4826-976b-ebea3b9946ac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Request method failure captured: Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f HTTP/1.1 Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7ElD_3ntrMeTQ6nqkQO0ZKs5Bh4rc9U5lsNxGAdK9rAI0Rac0CNBwJCjJnUkHL4sl5Ri7rv7DOVHXDrhEi_0-xs_KxUBkRkoMbF6qP-pTgeFAE7JirAXh4BKegMRfm7yDkVzv7GFFTfEb-5Iz5NOvDVAu37_dBU_4IGM6MU5KZU6l4Y Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 49576f2166cc4b7f9261bd7cbc8384f4 Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:41:37.130721 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:41:37.132391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/49576f2166cc4b7f9261bd7cbc8384f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_49576f2166cc4b7f9261bd7cbc8384f4", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/49576f2166cc4b7f9261bd7cbc8384f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/49576f2166cc4b7f9261bd7cbc8384f4"}]}] Aug 04 22:41:37.132391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:41:37.132391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 49576f2166cc4b7f9261bd7cbc8384f4 Aug 04 22:41:37.132391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:41:37.132391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-TestVolumeBootPattern-1400051087-project Aug 04 22:41:37.132391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:41:37.132391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:41:37.132391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 43e543cfa3e1402e9694dcb095a26c00 Aug 04 22:41:37.132391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-TestVolumeBootPattern-1400051087-project Aug 04 22:41:37.132391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:41:37.132391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance afc809f4-d5a3-43ab-98bf-50fcd034286f could not be found. Aug 04 22:41:37.132391 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'afc809f4-d5a3-43ab-98bf-50fcd034286f'} Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc809f4-d5a3-43ab-98bf-50fcd034286f could not be found. Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:41:37.133250 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc809f4-d5a3-43ab-98bf-50fcd034286f could not be found. Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc809f4-d5a3-43ab-98bf-50fcd034286f could not be found. Aug 04 22:41:37.134989 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:37.136568 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-5ae637e0-3764-4826-976b-ebea3b9946ac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Returning 404 to user: Instance afc809f4-d5a3-43ab-98bf-50fcd034286f could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:41:37.136568 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-5ae637e0-3764-4826-976b-ebea3b9946ac tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f" status: 404 len: 111 microversion: 2.1 time: 0.030892 Aug 04 22:41:37.136568 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 675/1341] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:41:37 2022] GET /compute/v2.1/servers/afc809f4-d5a3-43ab-98bf-50fcd034286f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:41:40.178658 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-5f48a8f7-3588-443e-9b69-7f67accf9db8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:41:40.179745 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-5f48a8f7-3588-443e-9b69-7f67accf9db8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:41:40.180821 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-1cb9f440-e08d-4fbe-8cd0-ce38751a0554 req-2e48d75b-61d7-4fca-8510-1276dd22f93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e6e910-3014-436c-b435-81eda236a12e", "tag": "c1912177-8d34-41b0-8788-ceb570a14070"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:41:40.185811 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5f48a8f7-3588-443e-9b69-7f67accf9db8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:40.186310 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5f48a8f7-3588-443e-9b69-7f67accf9db8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:40.186750 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5f48a8f7-3588-443e-9b69-7f67accf9db8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:40.187701 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5f48a8f7-3588-443e-9b69-7f67accf9db8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:40.188162 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5f48a8f7-3588-443e-9b69-7f67accf9db8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:40.188593 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-5f48a8f7-3588-443e-9b69-7f67accf9db8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:40.192717 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-1cb9f440-e08d-4fbe-8cd0-ce38751a0554 req-2e48d75b-61d7-4fca-8510-1276dd22f93e service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:40.193555 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-1cb9f440-e08d-4fbe-8cd0-ce38751a0554 req-2e48d75b-61d7-4fca-8510-1276dd22f93e service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:40.194226 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-1cb9f440-e08d-4fbe-8cd0-ce38751a0554 req-2e48d75b-61d7-4fca-8510-1276dd22f93e service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:40.209430 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-1cb9f440-e08d-4fbe-8cd0-ce38751a0554 req-2e48d75b-61d7-4fca-8510-1276dd22f93e service nova] Creating event network-changed:c1912177-8d34-41b0-8788-ceb570a14070 for instance d3e6e910-3014-436c-b435-81eda236a12e on hv-cinder-85221 Aug 04 22:41:40.214769 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-1cb9f440-e08d-4fbe-8cd0-ce38751a0554 req-2e48d75b-61d7-4fca-8510-1276dd22f93e service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037739 Aug 04 22:41:40.215456 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 676/1342] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:41:40.217046 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-5f48a8f7-3588-443e-9b69-7f67accf9db8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Going to try to terminate instance {{(pid=129197) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:41:40.301684 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-5f48a8f7-3588-443e-9b69-7f67accf9db8 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "DELETE /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 204 len: 0 microversion: 2.1 time: 0.127650 Aug 04 22:41:40.306029 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 667/1343] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:41:40 2022] DELETE /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:41:40.318979 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-176f8af1-9844-4dcd-86e8-2354447dc7ee tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:41:40.319683 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-176f8af1-9844-4dcd-86e8-2354447dc7ee tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:41:40.330563 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-176f8af1-9844-4dcd-86e8-2354447dc7ee tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:40.331768 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-176f8af1-9844-4dcd-86e8-2354447dc7ee tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:40.332219 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-176f8af1-9844-4dcd-86e8-2354447dc7ee tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:40.338254 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-176f8af1-9844-4dcd-86e8-2354447dc7ee tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:40.338938 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-176f8af1-9844-4dcd-86e8-2354447dc7ee tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:40.341622 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-176f8af1-9844-4dcd-86e8-2354447dc7ee tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:40.476005 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.policy [None req-176f8af1-9844-4dcd-86e8-2354447dc7ee tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129196) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:41:40.483680 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-176f8af1-9844-4dcd-86e8-2354447dc7ee tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1579 microversion: 2.1 time: 0.175677 Aug 04 22:41:40.484244 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 677/1344] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:41:40 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:41:41.506537 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-04093b0b-c6e3-414e-9f8e-7b20762ab343 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:41:41.507241 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-04093b0b-c6e3-414e-9f8e-7b20762ab343 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:41:41.513493 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-04093b0b-c6e3-414e-9f8e-7b20762ab343 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:41.513974 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-04093b0b-c6e3-414e-9f8e-7b20762ab343 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:41.514430 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-04093b0b-c6e3-414e-9f8e-7b20762ab343 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:41.515117 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-04093b0b-c6e3-414e-9f8e-7b20762ab343 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:41.515569 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-04093b0b-c6e3-414e-9f8e-7b20762ab343 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:41.516010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-04093b0b-c6e3-414e-9f8e-7b20762ab343 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:41.646230 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-04093b0b-c6e3-414e-9f8e-7b20762ab343 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:41:41.653734 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-04093b0b-c6e3-414e-9f8e-7b20762ab343 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1579 microversion: 2.1 time: 0.152053 Aug 04 22:41:41.654314 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 668/1345] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:41:41 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1579 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:41:42.618441 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [req-6fdbb2f1-c5ca-4a87-ba62-4d904ffabdb8 req-7faa67eb-30ea-478e-a511-ef935adb2d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e6e910-3014-436c-b435-81eda236a12e", "name": "network-vif-deleted", "tag": "c1912177-8d34-41b0-8788-ceb570a14070"}]} {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:41:42.628709 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-6fdbb2f1-c5ca-4a87-ba62-4d904ffabdb8 req-7faa67eb-30ea-478e-a511-ef935adb2d33 service nova] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:42.629116 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-6fdbb2f1-c5ca-4a87-ba62-4d904ffabdb8 req-7faa67eb-30ea-478e-a511-ef935adb2d33 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:42.629566 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [req-6fdbb2f1-c5ca-4a87-ba62-4d904ffabdb8 req-7faa67eb-30ea-478e-a511-ef935adb2d33 service nova] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:42.640325 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.compute.server_external_events [req-6fdbb2f1-c5ca-4a87-ba62-4d904ffabdb8 req-7faa67eb-30ea-478e-a511-ef935adb2d33 service nova] Creating event network-vif-deleted:c1912177-8d34-41b0-8788-ceb570a14070 for instance d3e6e910-3014-436c-b435-81eda236a12e on hv-cinder-85221 Aug 04 22:41:42.645912 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [req-6fdbb2f1-c5ca-4a87-ba62-4d904ffabdb8 req-7faa67eb-30ea-478e-a511-ef935adb2d33 service nova] 10.222.0.109 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031425 Aug 04 22:41:42.646550 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 678/1346] 10.222.0.109 () {64 vars in 1322 bytes} [Thu Aug 4 22:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:41:42.676724 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-0a9e2034-ea4d-46dc-a887-5c50a33e7a34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:41:42.677349 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-0a9e2034-ea4d-46dc-a887-5c50a33e7a34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:41:42.683764 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a9e2034-ea4d-46dc-a887-5c50a33e7a34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:42.684258 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a9e2034-ea4d-46dc-a887-5c50a33e7a34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:42.684698 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a9e2034-ea4d-46dc-a887-5c50a33e7a34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:42.685457 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a9e2034-ea4d-46dc-a887-5c50a33e7a34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:42.685922 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a9e2034-ea4d-46dc-a887-5c50a33e7a34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:42.686353 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-0a9e2034-ea4d-46dc-a887-5c50a33e7a34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:42.749789 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.policy [None req-0a9e2034-ea4d-46dc-a887-5c50a33e7a34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e543cfa3e1402e9694dcb095a26c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49576f2166cc4b7f9261bd7cbc8384f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:41:42.758060 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-0a9e2034-ea4d-46dc-a887-5c50a33e7a34 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 200 len: 1228 microversion: 2.1 time: 0.085966 Aug 04 22:41:42.758657 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 669/1347] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:41:42 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:41:43.779055 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e0c8c8e9-7227-4a25-9783-6b7ca36d753a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:41:43.779751 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-e0c8c8e9-7227-4a25-9783-6b7ca36d753a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: d3e6e910-3014-436c-b435-81eda236a12e] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:41:43.786104 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e0c8c8e9-7227-4a25-9783-6b7ca36d753a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:43.786583 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e0c8c8e9-7227-4a25-9783-6b7ca36d753a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:43.787016 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e0c8c8e9-7227-4a25-9783-6b7ca36d753a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:43.787704 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e0c8c8e9-7227-4a25-9783-6b7ca36d753a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:43.788159 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e0c8c8e9-7227-4a25-9783-6b7ca36d753a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:43.788583 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-e0c8c8e9-7227-4a25-9783-6b7ca36d753a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:43.801677 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-e0c8c8e9-7227-4a25-9783-6b7ca36d753a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] HTTP exception thrown: Instance d3e6e910-3014-436c-b435-81eda236a12e could not be found. Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e0c8c8e9-7227-4a25-9783-6b7ca36d753a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Request method failure captured: Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e HTTP/1.1 Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7ElD_3ntrMeTQ6nqkQO0ZKs5Bh4rc9U5lsNxGAdK9rAI0Rac0CNBwJCjJnUkHL4sl5Ri7rv7DOVHXDrhEi_0-xs_KxUBkRkoMbF6qP-pTgeFAE7JirAXh4BKegMRfm7yDkVzv7GFFTfEb-5Iz5NOvDVAu37_dBU_4IGM6MU5KZU6l4Y Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 49576f2166cc4b7f9261bd7cbc8384f4 Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:41:43.803299 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:41:43.805083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/49576f2166cc4b7f9261bd7cbc8384f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_49576f2166cc4b7f9261bd7cbc8384f4", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/49576f2166cc4b7f9261bd7cbc8384f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/49576f2166cc4b7f9261bd7cbc8384f4"}]}] Aug 04 22:41:43.805083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:41:43.805083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 49576f2166cc4b7f9261bd7cbc8384f4 Aug 04 22:41:43.805083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:41:43.805083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-TestVolumeBootPattern-1400051087-project Aug 04 22:41:43.805083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:41:43.805083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:41:43.805083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 43e543cfa3e1402e9694dcb095a26c00 Aug 04 22:41:43.805083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-TestVolumeBootPattern-1400051087-project Aug 04 22:41:43.805083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:41:43.805083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance d3e6e910-3014-436c-b435-81eda236a12e could not be found. Aug 04 22:41:43.805083 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': 'd3e6e910-3014-436c-b435-81eda236a12e'} Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3e6e910-3014-436c-b435-81eda236a12e could not be found. Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:41:43.806178 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3e6e910-3014-436c-b435-81eda236a12e could not be found. Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3e6e910-3014-436c-b435-81eda236a12e could not be found. Aug 04 22:41:43.807754 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:43.809591 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-e0c8c8e9-7227-4a25-9783-6b7ca36d753a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Returning 404 to user: Instance d3e6e910-3014-436c-b435-81eda236a12e could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:41:43.809591 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-e0c8c8e9-7227-4a25-9783-6b7ca36d753a tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e" status: 404 len: 111 microversion: 2.1 time: 0.030390 Aug 04 22:41:43.809591 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 679/1348] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:41:43 2022] GET /compute/v2.1/servers/d3e6e910-3014-436c-b435-81eda236a12e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:41:44.245350 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-691a7885-43ea-4d61-bc2e-63d38bec73df tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:41:44.246010 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.compute.api [None req-691a7885-43ea-4d61-bc2e-63d38bec73df tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129197) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:41:44.252985 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-691a7885-43ea-4d61-bc2e-63d38bec73df tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:44.253497 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-691a7885-43ea-4d61-bc2e-63d38bec73df tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:44.253941 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-691a7885-43ea-4d61-bc2e-63d38bec73df tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:44.254651 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-691a7885-43ea-4d61-bc2e-63d38bec73df tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:44.255103 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-691a7885-43ea-4d61-bc2e-63d38bec73df tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:44.255521 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG oslo_concurrency.lockutils [None req-691a7885-43ea-4d61-bc2e-63d38bec73df tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:44.268729 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.wsgi [None req-691a7885-43ea-4d61-bc2e-63d38bec73df tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] HTTP exception thrown: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-691a7885-43ea-4d61-bc2e-63d38bec73df tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Request method failure captured: Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: request: DELETE /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 HTTP/1.1 Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept: application/json Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Accept-Encoding: identity Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Connection: close Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Length: 0 Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Content-Type: application/json Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Host: 10.222.0.109 Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Openstack-System-Scope: None Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: User-Agent: python-urllib3/1.26.11 Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Auth-Token: gAAAAABi7ElD_3ntrMeTQ6nqkQO0ZKs5Bh4rc9U5lsNxGAdK9rAI0Rac0CNBwJCjJnUkHL4sl5Ri7rv7DOVHXDrhEi_0-xs_KxUBkRkoMbF6qP-pTgeFAE7JirAXh4BKegMRfm7yDkVzv7GFFTfEb-5Iz5NOvDVAu37_dBU_4IGM6MU5KZU6l4Y Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Id: None Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Domain-Name: None Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Identity-Status: Confirmed Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Is-Admin-Project: True Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Id: default Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Domain-Name: Default Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Id: 49576f2166cc4b7f9261bd7cbc8384f4 Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Project-Name: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Role: member,reader Aug 04 22:41:44.270407 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Roles: member,reader Aug 04 22:41:44.272143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/49576f2166cc4b7f9261bd7cbc8384f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_49576f2166cc4b7f9261bd7cbc8384f4", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/49576f2166cc4b7f9261bd7cbc8384f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/49576f2166cc4b7f9261bd7cbc8384f4"}]}] Aug 04 22:41:44.272143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:41:44.272143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Id: 49576f2166cc4b7f9261bd7cbc8384f4 Aug 04 22:41:44.272143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-Tenant-Name: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:41:44.272143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User: tempest-TestVolumeBootPattern-1400051087-project Aug 04 22:41:44.272143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Id: default Aug 04 22:41:44.272143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Domain-Name: Default Aug 04 22:41:44.272143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Id: 43e543cfa3e1402e9694dcb095a26c00 Aug 04 22:41:44.272143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: X-User-Name: tempest-TestVolumeBootPattern-1400051087-project Aug 04 22:41:44.272143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: method: > Aug 04 22:41:44.272143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: exception: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:41:44.272143 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: action_args: {'id': '7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6'} Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:41:44.273109 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:41:44.274547 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: ERROR nova.api.openstack.wsgi Aug 04 22:41:44.275939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-691a7885-43ea-4d61-bc2e-63d38bec73df tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Returning 404 to user: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. {{(pid=129197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:41:44.275939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-691a7885-43ea-4d61-bc2e-63d38bec73df tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "DELETE /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 404 len: 111 microversion: 2.1 time: 0.030552 Aug 04 22:41:44.275939 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 670/1349] 10.222.0.109 () {58 vars in 1244 bytes} [Thu Aug 4 22:41:44 2022] DELETE /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:41:44.280352 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ffa9f650-8ea6-40c9-a493-a4f96606bf35 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '>' {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:41:44.280960 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.compute.api [None req-ffa9f650-8ea6-40c9-a493-a4f96606bf35 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] [instance: 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6] Fetching instance by UUID {{(pid=129196) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:41:44.286832 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ffa9f650-8ea6-40c9-a493-a4f96606bf35 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:44.287302 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ffa9f650-8ea6-40c9-a493-a4f96606bf35 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:44.287729 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ffa9f650-8ea6-40c9-a493-a4f96606bf35 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:44.288415 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ffa9f650-8ea6-40c9-a493-a4f96606bf35 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Acquiring lock "cabbb7be-13c8-431a-acef-35fafb43c245" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:41:44.288857 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ffa9f650-8ea6-40c9-a493-a4f96606bf35 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:41:44.289272 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG oslo_concurrency.lockutils [None req-ffa9f650-8ea6-40c9-a493-a4f96606bf35 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Lock "cabbb7be-13c8-431a-acef-35fafb43c245" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:41:44.302986 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.wsgi [None req-ffa9f650-8ea6-40c9-a493-a4f96606bf35 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] HTTP exception thrown: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ffa9f650-8ea6-40c9-a493-a4f96606bf35 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Request method failure captured: Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: request: GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 HTTP/1.1 Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept: application/json Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Accept-Encoding: identity Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Connection: close Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Length: 0 Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Content-Type: application/json Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Host: 10.222.0.109 Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Openstack-System-Scope: None Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: User-Agent: python-urllib3/1.26.11 Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Auth-Token: gAAAAABi7ElD_3ntrMeTQ6nqkQO0ZKs5Bh4rc9U5lsNxGAdK9rAI0Rac0CNBwJCjJnUkHL4sl5Ri7rv7DOVHXDrhEi_0-xs_KxUBkRkoMbF6qP-pTgeFAE7JirAXh4BKegMRfm7yDkVzv7GFFTfEb-5Iz5NOvDVAu37_dBU_4IGM6MU5KZU6l4Y Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Id: None Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Domain-Name: None Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Identity-Status: Confirmed Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Is-Admin-Project: True Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Id: default Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Domain-Name: Default Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Id: 49576f2166cc4b7f9261bd7cbc8384f4 Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Project-Name: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Role: member,reader Aug 04 22:41:44.304453 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Roles: member,reader Aug 04 22:41:44.306712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2/49576f2166cc4b7f9261bd7cbc8384f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109:8080/v1/AUTH_49576f2166cc4b7f9261bd7cbc8384f4", "adminURL": "http://10.222.0.109:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/49576f2166cc4b7f9261bd7cbc8384f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.109/volume/v3/49576f2166cc4b7f9261bd7cbc8384f4"}]}] Aug 04 22:41:44.306712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:41:44.306712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Id: 49576f2166cc4b7f9261bd7cbc8384f4 Aug 04 22:41:44.306712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-Tenant-Name: tempest-TestVolumeBootPattern-1400051087 Aug 04 22:41:44.306712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User: tempest-TestVolumeBootPattern-1400051087-project Aug 04 22:41:44.306712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Id: default Aug 04 22:41:44.306712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Domain-Name: Default Aug 04 22:41:44.306712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Id: 43e543cfa3e1402e9694dcb095a26c00 Aug 04 22:41:44.306712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: X-User-Name: tempest-TestVolumeBootPattern-1400051087-project Aug 04 22:41:44.306712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: method: > Aug 04 22:41:44.306712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: exception: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:41:44.306712 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: action_args: {'id': '7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6'} Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: {{(pid=129196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:41:44.307694 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. Aug 04 22:41:44.309459 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: ERROR nova.api.openstack.wsgi Aug 04 22:41:44.311101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: DEBUG nova.api.openstack.wsgi [None req-ffa9f650-8ea6-40c9-a493-a4f96606bf35 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Returning 404 to user: Instance 7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 could not be found. {{(pid=129196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:41:44.311101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO nova.api.openstack.requestlog [None req-ffa9f650-8ea6-40c9-a493-a4f96606bf35 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6" status: 404 len: 111 microversion: 2.1 time: 0.029285 Aug 04 22:41:44.311101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: [pid: 129196|app: 0|req: 680/1350] 10.222.0.109 () {58 vars in 1241 bytes} [Thu Aug 4 22:41:44 2022] GET /compute/v2.1/servers/7b50796b-d3ec-495e-9b1b-3a56dbbc9fd6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:41:45.597318 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: DEBUG nova.api.openstack.wsgi [None req-edbbf26e-0da0-4426-ba6a-7908fe3b68a0 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] Calling method '.version_select at 0x7fe7b17544c0>' {{(pid=129197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:41:45.616576 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO nova.api.openstack.requestlog [None req-edbbf26e-0da0-4426-ba6a-7908fe3b68a0 tempest-TestVolumeBootPattern-1400051087 tempest-TestVolumeBootPattern-1400051087-project] 10.222.0.109 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1818150918" status: 202 len: 0 microversion: 2.1 time: 0.023094 Aug 04 22:41:45.617082 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: [pid: 129197|app: 0|req: 671/1351] 10.222.0.109 () {58 vars in 1268 bytes} [Thu Aug 4 22:41:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1818150918 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:42:02.469772 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:42:02.470283 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Thu Aug 4 22:42:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:42:03.915221 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:42:03.915879 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Thu Aug 4 22:42:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:42:06.140351 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:42:06.140836 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Thu Aug 4 22:42:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:44:02.155003 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:44:02.155528 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Thu Aug 4 22:44:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:45:22.478481 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:45:22.479129 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Thu Aug 4 22:45:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:45:23.928351 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:45:23.929292 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Thu Aug 4 22:45:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:45:26.149256 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:45:26.149798 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Thu Aug 4 22:45:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:46:57.466701 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:46:57.467288 dv-cinder-852211-1-iscsi devstack@n-api.service[129197]: Thu Aug 4 22:46:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:47:18.658101 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:47:18.658688 dv-cinder-852211-1-iscsi devstack@n-api.service[129196]: Thu Aug 4 22:47:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!